-- Logs begin at Tue 2022-07-12 17:42:44 UTC, end at Tue 2022-07-12 19:14:12 UTC. -- Jul 12 18:38:40.299726 dv-cinder-835384-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 18:38:40.308704 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:38:40 2022] *** Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: nodename: dv-cinder-835384-15-iscsi Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: machine: x86_64 Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: clock source: unix Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: pcre jit disabled Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: detected number of CPU cores: 4 Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: current working directory: / Jul 12 18:38:40.310723 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: your processes number limit is 47680 Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: your memory page size is 4096 bytes Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: detected max file descriptor number: 2048 Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: lock engine: pthread robust mutexes Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: thunder lock: enabled Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 18:38:40.311472 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:38:40.356676 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: Python main interpreter initialized at 0x55fe0641a9c0 Jul 12 18:38:40.356676 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: python threads support enabled Jul 12 18:38:40.356676 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: your server socket listen backlog is limited to 100 connections Jul 12 18:38:40.356676 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:38:40.357101 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:38:40.357101 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: *** Operational MODE: preforking *** Jul 12 18:38:40.357409 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:38:40.357409 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: spawned uWSGI master process (pid: 110427) Jul 12 18:38:40.357626 dv-cinder-835384-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 18:38:40.358726 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: spawned uWSGI worker 1 (pid: 110428, cores: 1) Jul 12 18:38:40.358726 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: spawned uWSGI worker 2 (pid: 110429, cores: 1) Jul 12 18:38:40.358726 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:38:41.046146 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:38:41.048201 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:38:42.188359 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:38:42.188359 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: from cryptography.utils import int_from_bytes Jul 12 18:38:42.189072 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:38:42.189072 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: from cryptography.utils import int_from_bytes Jul 12 18:38:42.191260 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:38:42.191260 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: from cryptography.utils import int_from_bytes Jul 12 18:38:42.191729 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:38:42.191729 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: from cryptography.utils import int_from_bytes Jul 12 18:38:44.709424 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:38:44.709998 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:38:44.709998 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:38:44.710420 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:38:44.710516 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:38:44.710600 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:38:44.710693 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:38:44.710777 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:38:44.710857 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:38:44.710935 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:38:44.711152 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.711279 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.711499 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.711596 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.711817 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.711904 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.712133 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.712222 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.712458 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.712581 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.713360 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.713480 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.713723 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.713883 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714055 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714160 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714512 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714627 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714710 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714788 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.714955 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715106 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715234 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-15-iscsi {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715466 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-15-iscsi {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715577 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715803 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.715950 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716139 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716237 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716425 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716518 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716746 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.716842 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717053 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717150 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717354 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717451 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717674 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.717853 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.718181 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719209 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719324 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719421 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719598 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719678 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719817 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.719902 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720037 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720130 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720215 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720300 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720386 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720466 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720593 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720685 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720766 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.720948 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721044 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721255 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721358 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-15-iscsi {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721655 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-15-iscsi {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721743 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.721963 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722091 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722274 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722368 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722586 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722679 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.722982 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723078 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723288 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723410 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723620 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723707 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.723945 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724032 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724249 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724341 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724566 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724650 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724878 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.724964 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725192 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725290 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725508 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725594 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725802 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.725951 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726107 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726222 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726412 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726508 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726723 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.726817 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727021 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727106 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727338 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727429 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727591 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727679 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727893 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.727987 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.728283 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.728480 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.728619 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.728817 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729033 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729123 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729202 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729326 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729463 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729640 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729728 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.729956 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730044 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730262 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730357 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730566 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730652 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730868 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.730954 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731266 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731496 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731597 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731800 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.731893 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732101 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732209 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732402 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732489 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732704 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.732838 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733011 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733115 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733326 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733413 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733629 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733723 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.733943 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734037 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734247 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734333 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734567 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734662 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734870 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.734964 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735203 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735290 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735537 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735634 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735839 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.735927 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736154 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736242 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736470 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736563 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736772 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.736859 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737074 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737174 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737386 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737471 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737693 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737780 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.737999 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738094 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738322 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738423 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738569 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738655 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738866 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.738963 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739166 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739267 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739501 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739600 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739804 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.739890 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740106 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740202 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740407 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740500 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740703 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.740790 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741004 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741099 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741302 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741396 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741600 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741686 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741902 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.741990 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742202 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742296 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742505 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742598 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742806 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.742892 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.743104 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.743198 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.743427 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.743518 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.743764 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744016 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744478 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744589 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744682 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744769 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744864 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.744946 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745024 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745156 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745245 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745464 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745559 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745772 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.745861 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746080 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746176 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746398 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746489 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746698 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746796 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.746996 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.747091 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.747369 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.747480 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.747630 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.747718 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748180 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748273 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748492 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748592 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748787 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.748933 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749087 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749219 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749397 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749486 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749697 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749782 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.749993 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750078 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750290 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750378 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750588 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750676 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750883 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.750970 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751180 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751268 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751501 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751591 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751799 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.751886 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752093 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752188 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752395 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752487 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752701 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.752798 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753002 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753088 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753303 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753397 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753604 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753705 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.753916 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.754009 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.754222 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.754310 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.754529 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.754625 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.754850 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:38:44.754948 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755171 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755265 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755526 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755698 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755852 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.755952 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756166 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756300 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756472 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756561 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756781 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.756870 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757098 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757185 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757402 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757490 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757706 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.757800 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758011 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758105 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758322 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758411 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758635 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758749 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.758943 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.759041 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.759251 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.759944 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760524 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760622 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760704 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760784 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760879 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.760961 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761094 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761188 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761420 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761509 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761737 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.761827 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762044 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762139 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762370 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762464 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762691 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.762779 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763001 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763095 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763332 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763435 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763655 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763750 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.763961 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764048 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764266 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764362 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764572 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764659 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764888 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.764975 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765202 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765297 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765512 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765606 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765824 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.765909 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766133 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766220 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766442 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766528 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766750 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.766836 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767057 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767146 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767387 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767477 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767701 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.767787 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768017 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768106 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768324 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768409 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768633 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768720 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.768946 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769086 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769253 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769378 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769559 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769867 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.769963 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770167 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770255 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770467 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770579 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770803 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.770904 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771071 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771159 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771397 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771518 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771712 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.771853 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772021 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772109 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772325 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772420 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772644 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772744 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.772943 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773028 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773250 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773556 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773649 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773862 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.773950 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774163 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774251 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774470 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774555 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774793 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.774893 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.775778 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776238 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776331 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776411 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776492 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776569 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776659 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776740 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.776945 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777063 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777256 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777375 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777563 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777681 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.777886 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778014 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778198 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778332 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778501 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778597 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778814 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.778909 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779126 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779322 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779465 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779554 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779778 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.779868 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780089 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780185 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780413 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780511 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780726 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.780826 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781038 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781133 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781358 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781455 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781678 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781765 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.781983 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782078 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782285 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782372 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782591 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782678 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782892 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.782981 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783195 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783283 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783520 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783610 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783824 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.783912 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784123 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784211 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784425 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784518 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784723 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.784813 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785021 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785109 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785321 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785417 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785640 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785739 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.785944 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786031 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786250 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786348 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786564 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786655 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786871 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.786995 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787174 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787271 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787593 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787809 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.787896 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788150 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788239 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788456 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788544 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788780 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.788865 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789090 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789179 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789403 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789498 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789710 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.789797 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790017 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790105 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790323 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790410 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790655 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.790813 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791370 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791466 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791466 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791631 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791711 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791790 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791879 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.791960 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792191 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792279 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792501 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792597 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792810 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.792897 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793108 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793202 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793420 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793515 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793753 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.793840 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794079 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794174 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794391 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794494 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794708 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.794796 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795013 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795099 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795343 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795447 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795652 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795743 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.795958 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796046 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796264 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796353 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796568 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796705 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.796970 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797188 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797276 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797496 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797582 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797800 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.797886 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798115 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798208 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798419 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798512 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798731 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.798817 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799028 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799122 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799354 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799437 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799681 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.799779 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800003 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800090 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800306 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800398 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800612 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800708 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.800927 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801016 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801235 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801324 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801542 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801643 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801848 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.801936 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802153 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802240 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802453 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802553 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802759 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.802846 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803062 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803156 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803381 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803487 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803691 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803778 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.803992 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804080 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804302 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804427 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804603 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804689 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804905 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.804991 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805203 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805297 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805510 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805604 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805813 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.805899 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.806120 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.806209 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807166 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807569 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807667 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807758 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807841 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.807922 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808002 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808124 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808283 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808449 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808592 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808744 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.808894 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809053 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809197 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809379 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809511 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809691 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809821 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.809998 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810127 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810304 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810497 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810628 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810745 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.810973 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811061 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811288 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811415 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811617 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811705 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.811934 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812031 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812254 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812347 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812563 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812649 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812878 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.812972 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813181 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813268 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813485 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813573 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813792 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.813887 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814097 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814191 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814402 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814496 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814713 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.814808 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815016 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815101 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815353 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815445 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815652 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815742 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.815952 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816088 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816260 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816360 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816567 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816657 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.816877 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817141 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817276 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817475 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817588 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817790 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.817888 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.818113 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.818352 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.818457 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.818690 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.818797 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819010 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819105 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819353 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819464 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819681 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.819782 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820002 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820112 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820315 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820409 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820621 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820724 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.820924 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821138 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821244 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821334 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821522 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821618 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821827 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.821983 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.822290 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.822387 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.822609 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.822731 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.822920 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823011 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823230 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823356 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823568 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823670 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823872 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.823958 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824179 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824306 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824480 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824583 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824784 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.824870 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825085 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825172 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825397 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825493 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825701 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.825787 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826004 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826099 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826305 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826401 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826604 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826693 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.826924 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827011 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827245 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827410 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827561 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827677 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827895 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.827989 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828232 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828328 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828537 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828631 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828836 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.828923 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829155 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829255 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829457 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829544 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829758 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.829857 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830057 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830146 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830363 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830450 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830666 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830762 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.830964 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831052 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831270 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831389 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831597 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831703 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831901 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.831989 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832202 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832296 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832499 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832659 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832809 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.832892 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833109 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833205 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833416 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833717 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.833804 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834017 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834105 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834315 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834401 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834621 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834710 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.834923 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835017 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835220 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835329 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835547 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835646 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835844 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.835939 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836153 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836240 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836449 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836534 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836747 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.836847 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.837044 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.837131 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.837346 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838012 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838625 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838728 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838812 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838911 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.838997 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.839094 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.839176 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.839255 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.839771 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.839899 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840022 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840131 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840247 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840365 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840472 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840587 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840707 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840816 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.840938 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841047 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841154 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841260 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841428 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841545 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841728 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.841845 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842033 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842156 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842334 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842451 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842639 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842756 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.842936 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843053 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843240 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843410 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843563 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843679 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843863 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.843979 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844161 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844285 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844458 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844574 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844756 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.844886 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845065 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845162 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845369 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845456 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845671 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845758 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.845971 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846072 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846270 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846359 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846586 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846673 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846892 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.846988 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847199 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847286 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847529 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847617 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847851 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.847946 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848165 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848252 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848469 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848562 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848776 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.848865 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849083 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849171 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849467 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849687 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849783 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.849993 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850081 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850299 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850387 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850596 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850686 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850893 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.850981 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851207 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851354 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851533 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851621 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851841 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.851936 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852142 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852237 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852548 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852769 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.852857 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.853070 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.853215 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.853476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.853932 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854026 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854109 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854199 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854292 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854381 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854490 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854581 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854804 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.854947 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855208 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855458 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855551 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855777 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.855878 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856079 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856167 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856380 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856467 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856685 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856781 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.856987 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857084 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857286 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857388 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857596 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857730 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.857897 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858034 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858195 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858328 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858498 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858595 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858796 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.858884 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859100 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859187 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859421 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859511 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859747 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.859833 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860060 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860150 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860368 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860493 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860681 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860770 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.860989 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861076 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861299 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861663 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861759 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.861974 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862075 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862274 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862363 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862631 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862718 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.862944 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863040 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863263 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863383 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863592 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863690 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863893 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.863992 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864191 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864311 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864496 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864648 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864812 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.864910 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865111 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865224 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865408 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865532 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865704 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.865839 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866019 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866149 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866317 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866476 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866629 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.866783 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867038 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867132 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867361 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867452 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867662 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.867798 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.868007 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.868105 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.868330 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.868419 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.868646 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.869358 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.869833 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870000 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870084 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870164 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870255 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870337 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870567 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870656 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870878 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.870975 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871185 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871274 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871539 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871637 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871864 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.871963 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872172 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872341 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872483 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872572 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872783 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.872872 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.873374 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.873470 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.873703 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.873791 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874012 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874100 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874327 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874423 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874638 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874774 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.874964 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875096 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875287 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875447 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875641 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875730 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.875966 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876053 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876269 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876380 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876569 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876706 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.876875 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877017 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877175 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877341 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877474 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877665 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877798 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.877974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878075 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878281 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878370 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878594 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878692 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.878945 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879042 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879245 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879353 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879572 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879662 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879889 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.879986 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880189 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880278 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880504 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880592 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880812 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.880899 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881117 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881212 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881511 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881721 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.881809 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882038 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882125 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882342 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882430 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882643 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882732 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.882942 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883029 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883246 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883402 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883596 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883690 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883896 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.883983 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.884211 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.884313 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.884591 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.884713 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.884922 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885270 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885414 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885542 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885633 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885840 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.885931 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886147 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886234 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886460 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886557 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886778 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.886868 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887078 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887176 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887397 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887492 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887706 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.887796 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888005 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888651 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888750 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888832 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888913 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.888993 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889070 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889169 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889254 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889328 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889455 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889584 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889750 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.889896 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890065 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890255 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890352 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890603 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890700 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.890913 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891001 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891225 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891344 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891551 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891656 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891849 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.891938 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892152 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892239 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892468 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892564 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892771 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.892858 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893093 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893181 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893405 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893505 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893712 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.893800 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894015 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894102 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894318 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894456 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894628 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894716 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.894941 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895035 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895255 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895409 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895609 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895698 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.895934 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896022 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896313 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896402 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896626 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896712 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.896927 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897013 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897238 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897335 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897551 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897640 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897862 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.897957 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.898177 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.898418 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.898508 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.898742 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.898829 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899052 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899142 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899386 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899478 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899697 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.899796 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.900530 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901088 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901255 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901343 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901433 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901516 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901607 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901763 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.901853 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902079 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902400 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902492 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902715 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.902847 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903029 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903121 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903361 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903453 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903678 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903770 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.903987 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904074 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904297 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904387 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904605 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904693 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.904931 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905032 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905254 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905341 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905556 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905644 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905866 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.905963 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906175 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906272 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906485 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906585 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906793 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.906890 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907099 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907189 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907434 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907527 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907743 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.907842 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908049 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908138 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908354 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908455 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908663 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908749 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.908972 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909061 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909283 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909378 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909597 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909686 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.909912 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910000 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910218 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910313 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910527 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910623 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910834 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.910929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.911150 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.911365 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.911496 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.911679 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.911820 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912007 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912158 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912325 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912479 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912642 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912794 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.912956 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913110 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913268 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913430 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913590 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913898 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.913986 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914200 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914290 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914505 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914593 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914810 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.914912 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.915110 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.915198 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.915452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.915604 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.916357 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.916876 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.916977 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917061 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917149 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917232 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917313 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917403 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917719 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.917835 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918034 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918211 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918338 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918507 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918655 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918834 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.918973 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919159 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919284 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919500 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919619 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919809 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.919931 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.920131 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.920439 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.920556 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.920746 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.920862 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921059 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921174 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921369 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921486 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921670 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921785 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.921972 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.922087 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.922283 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.922400 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.922589 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.922706 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.923359 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.923460 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.923553 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.923706 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.923844 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.925946 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926060 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926155 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926240 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926322 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926554 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926646 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926730 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926811 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926898 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.926981 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927069 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927160 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927251 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927457 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927544 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927625 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927719 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927802 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927882 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.927963 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928050 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928133 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928222 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928306 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928394 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928600 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928689 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928781 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928865 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.928946 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929027 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929108 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929189 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929279 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929363 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929443 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929531 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929613 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929703 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929848 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.929968 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930164 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930287 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930472 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930596 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930783 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.930903 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.931143 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.931493 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.931740 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.932830 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.932830 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.932999 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.932999 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933148 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933148 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933294 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933376 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933457 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933537 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933617 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933711 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933795 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.933992 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934083 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934345 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934439 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934663 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934752 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.934969 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935207 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935317 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935574 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935676 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935890 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.935979 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936195 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936284 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936500 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936597 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936806 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.936894 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937110 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937214 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937416 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937505 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937721 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.937809 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938025 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938113 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938330 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938429 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938635 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938724 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.938943 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939030 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939253 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939363 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939600 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939702 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.939912 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940008 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940221 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940310 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940531 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940621 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940835 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.940931 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941141 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941238 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941448 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941537 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941753 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.941849 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942062 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942150 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942386 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942477 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942696 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942787 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.942997 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943084 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943357 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943462 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943658 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943748 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.943972 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944061 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944285 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944374 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944597 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944687 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944907 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.944994 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945222 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945323 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945527 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945616 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945842 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.945930 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946145 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946246 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946464 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946574 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946797 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.946925 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947552 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947657 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947657 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947830 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947913 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.947994 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948196 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948287 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948519 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948609 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948830 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.948930 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949142 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949233 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949445 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949533 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949742 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.949831 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950039 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950129 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950340 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950437 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950636 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950725 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.950934 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951033 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951231 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951347 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951552 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951659 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951854 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.951950 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952148 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952244 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952445 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952542 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952741 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.952830 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953037 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953126 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953333 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953482 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953630 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953719 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.953935 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954023 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954230 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954327 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954529 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954626 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954824 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.954913 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955120 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955210 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955435 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955527 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955739 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.955826 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956042 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956134 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956344 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956432 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956645 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956773 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.956952 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957049 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957254 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957342 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957555 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957652 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957855 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.957943 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958156 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958247 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958459 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958555 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958763 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.958873 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959090 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959190 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959418 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959568 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959726 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.959817 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960033 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960122 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960339 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960506 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960643 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960733 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.960951 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961040 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961270 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961358 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961585 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961681 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961885 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.961972 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.962206 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.962299 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.963036 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.963715 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.963715 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.963875 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.963966 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964049 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964130 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964211 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964298 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964431 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964592 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964741 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.964921 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965049 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965247 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965346 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965556 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965646 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965881 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.965970 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966200 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966301 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966520 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966610 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966838 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.966933 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967151 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967253 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967498 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967588 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967808 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.967894 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968117 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968207 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968432 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968528 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968743 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.968833 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969070 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969207 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969373 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969469 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969686 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969773 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.969995 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.970084 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.970296 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.970393 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.970537 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110428) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:38:44.970639 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.970939 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.971266 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.971637 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.971953 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.972295 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.972630 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.972949 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.973261 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.973569 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:38:44.973814 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110429) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:38:45.032850 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO dbcounter [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Registered counter for database nova_api Jul 12 18:38:45.036338 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO dbcounter [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Registered counter for database nova_api Jul 12 18:38:45.147608 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_db.sqlalchemy.engines [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.149215 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_db.sqlalchemy.engines [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.157087 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writer thread running {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.157289 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writer thread running {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.214435 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.context [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35fbcab1-4fbf-4d9a-acd5-685fb6ee233f(cell1) {{(pid=110428) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:38:45.216304 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.context [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35fbcab1-4fbf-4d9a-acd5-685fb6ee233f(cell1) {{(pid=110429) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:38:45.218464 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.220109 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.220319 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_concurrency.lockutils [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.220912 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.221915 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_concurrency.lockutils [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.222718 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_concurrency.lockutils [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:38:45.223002 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.225147 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO dbcounter [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Registered counter for database nova_cell0 Jul 12 18:38:45.226454 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_concurrency.lockutils [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=110429) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:38:45.228608 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO dbcounter [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Registered counter for database nova_cell0 Jul 12 18:38:45.229490 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO dbcounter [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Registered counter for database nova_cell1 Jul 12 18:38:45.233154 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO dbcounter [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Registered counter for database nova_cell1 Jul 12 18:38:45.239481 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_db.sqlalchemy.engines [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.240399 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_db.sqlalchemy.engines [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.241538 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_db.sqlalchemy.engines [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.242917 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_db.sqlalchemy.engines [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.249551 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writer thread running {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.249897 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writer thread running {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.254812 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writer thread running {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.256572 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writer thread running {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.397792 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO dbcounter [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Registered counter for database nova_cell0 Jul 12 18:38:45.404775 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO dbcounter [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Registered counter for database nova_cell0 Jul 12 18:38:45.410270 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_db.sqlalchemy.engines [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110428) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.413701 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG oslo_db.sqlalchemy.engines [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110429) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:38:45.414652 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writer thread running {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.418671 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writer thread running {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:38:45.874725 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: WARNING keystonemiddleware.auth_token [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:38:45.881961 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: WARNING keystonemiddleware.auth_token [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:38:45.903607 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: WARNING keystonemiddleware.auth_token [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:38:45.910902 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: WARNING keystonemiddleware.auth_token [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:38:46.225593 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: WARNING keystonemiddleware.auth_token [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:38:46.232184 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: WARNING keystonemiddleware.auth_token [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:38:46.237482 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe0641a9c0 pid: 110428 (default app) Jul 12 18:38:46.239572 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:38:46.240763 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jul 12 18:38:46.241167 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Tue Jul 12 18:38:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:38:46.261812 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: WARNING keystonemiddleware.auth_token [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:38:46.267908 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: WARNING keystonemiddleware.auth_token [None req-48686dda-a547-4807-b681-d2e9b9f02a0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:38:46.273175 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fe0641a9c0 pid: 110429 (default app) Jul 12 18:40:10.986277 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:10.987280 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 12 18:40:10.991079 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:11.001110 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_api:SELECT=3 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:11.002503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_cell0:SELECT=3 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:11.003374 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_cell1:SELECT=3 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:11.004093 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:11.896426 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-2ebc0a48-f4aa-4bae-b53c-0fe6e307374c admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:11.934544 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-2ebc0a48-f4aa-4bae-b53c-0fe6e307374c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.939072 Jul 12 18:40:11.935563 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Jul 12 18:40:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:14.355805 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:14.357467 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-28d715a0-db2d-4af8-977f-40ee118a6277 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Jul 12 18:40:14.359020 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:14.891743 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-03e67f59-937a-41f8-8ba9-56ae4457b11c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "id": "c1", "vcpus": 1}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:14.911034 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:40:14.911034 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: warnings.warn(msg) Jul 12 18:40:15.112996 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-03e67f59-937a-41f8-8ba9-56ae4457b11c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.740115 Jul 12 18:40:15.112996 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:15.127748 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_api:SELECT=3 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:15.128800 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_cell0:SELECT=3 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:15.129789 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_cell1:SELECT=3 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:15.131656 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:15.350490 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-d1d6f157-1ff5-4c4f-a2b0-7d7980a95a02 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:15.354585 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:40:15.354585 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:40:15.494668 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-d1d6f157-1ff5-4c4f-a2b0-7d7980a95a02 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.375803 Jul 12 18:40:15.495468 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Jul 12 18:40:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:18.117927 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-03e67f59-937a-41f8-8ba9-56ae4457b11c admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:18.120737 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-03e67f59-937a-41f8-8ba9-56ae4457b11c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003469 Jul 12 18:40:18.121490 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:18.921741 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-b29f5978-90d4-4ecf-a4e0-da2d703f8060 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:18.938986 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:40:18.938986 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:40:19.075437 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-b29f5978-90d4-4ecf-a4e0-da2d703f8060 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.943701 Jul 12 18:40:19.076421 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:19.093026 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-5b4621f5-71ca-4593-974a-c2fd5ce67341 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:19.094730 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:40:19.094730 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: warnings.warn(msg) Jul 12 18:40:19.227911 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-5b4621f5-71ca-4593-974a-c2fd5ce67341 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140012 Jul 12 18:40:19.235542 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Jul 12 18:40:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:21.636622 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-b29f5978-90d4-4ecf-a4e0-da2d703f8060 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:21.636622 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-b29f5978-90d4-4ecf-a4e0-da2d703f8060 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002299 Jul 12 18:40:21.636622 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:22.130607 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-0d095917-a121-4d47-bab5-0d6d1f077f55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G", "ram": 1024, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "swap": 0}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:22.218474 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-0d095917-a121-4d47-bab5-0d6d1f077f55 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.575574 Jul 12 18:40:22.219033 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:22.232441 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-a7bbe9a6-1606-49de-8fb7-afd5d0f6732c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:22.326427 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-a7bbe9a6-1606-49de-8fb7-afd5d0f6732c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097491 Jul 12 18:40:22.335436 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Jul 12 18:40:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:24.792126 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-0d095917-a121-4d47-bab5-0d6d1f077f55 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:24.793728 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-0d095917-a121-4d47-bab5-0d6d1f077f55 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002561 Jul 12 18:40:24.794602 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:25.309666 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-10c20363-bcd6-4f3c-bc47-65773c1e7d5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:25.390304 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-10c20363-bcd6-4f3c-bc47-65773c1e7d5b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.589047 Jul 12 18:40:25.390858 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:25.403490 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-609c4244-45bb-4373-af8f-2b9021469f52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:25.502549 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-609c4244-45bb-4373-af8f-2b9021469f52 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102785 Jul 12 18:40:25.503131 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Jul 12 18:40:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:27.857794 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-10c20363-bcd6-4f3c-bc47-65773c1e7d5b admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:27.858801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-10c20363-bcd6-4f3c-bc47-65773c1e7d5b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 12 18:40:27.859194 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:28.309326 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "swap": 0, "ram": 4096, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:28.417741 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552558 Jul 12 18:40:28.418663 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:28.431788 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-067eb27c-6e72-4a36-9322-a7f55fa3831f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:28.506018 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-067eb27c-6e72-4a36-9322-a7f55fa3831f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079185 Jul 12 18:40:28.506698 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1335 bytes} [Tue Jul 12 18:40:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:30.768723 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:30.769738 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 12 18:40:30.770137 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:31.210477 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-274dddd0-c48e-46ed-850c-c9bac750b667 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:31.234855 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-274dddd0-c48e-46ed-850c-c9bac750b667 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458468 Jul 12 18:40:31.236398 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Jul 12 18:40:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:40:33.501676 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:33.502749 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-9331a1ae-4dc9-4a9c-862d-99c82673b884 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jul 12 18:40:33.503177 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:33.974105 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-4397e32a-e708-4746-ab08-80762516dcfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "id": "1", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:34.033824 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-4397e32a-e708-4746-ab08-80762516dcfd admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.523255 Jul 12 18:40:34.034379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:34.047487 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-c6a3b0ee-64c9-477f-9699-d27f228270f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:34.100090 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-c6a3b0ee-64c9-477f-9699-d27f228270f7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056269 Jul 12 18:40:34.100685 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Jul 12 18:40:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:36.416148 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-4397e32a-e708-4746-ab08-80762516dcfd admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:36.417414 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-4397e32a-e708-4746-ab08-80762516dcfd admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002321 Jul 12 18:40:36.417823 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:36.865451 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-38647bb7-c31a-4a93-a71d-b63e2bed32f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "id": "2", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:36.954054 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-38647bb7-c31a-4a93-a71d-b63e2bed32f7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.528309 Jul 12 18:40:36.954836 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:36.966550 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-bb1a1461-578f-4612-89ab-63c5380a9dd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:37.042841 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-bb1a1461-578f-4612-89ab-63c5380a9dd2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079437 Jul 12 18:40:37.043486 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Jul 12 18:40:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:39.318317 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-38647bb7-c31a-4a93-a71d-b63e2bed32f7 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:39.319356 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-38647bb7-c31a-4a93-a71d-b63e2bed32f7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 12 18:40:39.319814 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:39.671448 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-e44152b5-c2dd-419c-af52-68abfe82273d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:39.754302 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-e44152b5-c2dd-419c-af52-68abfe82273d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.428624 Jul 12 18:40:39.754844 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:39.770600 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-6ec07ccd-f48b-422d-9d81-3bae52a1f98b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:39.860028 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-6ec07ccd-f48b-422d-9d81-3bae52a1f98b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095001 Jul 12 18:40:39.860613 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Jul 12 18:40:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:40:42.151683 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-e44152b5-c2dd-419c-af52-68abfe82273d admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:42.152681 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-e44152b5-c2dd-419c-af52-68abfe82273d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 12 18:40:42.153261 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:42.620544 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-ecb7f413-2c11-4091-a8a7-3dc3487182cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:42.626367 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:40:42.707938 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-ecb7f413-2c11-4091-a8a7-3dc3487182cf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.548287 Jul 12 18:40:42.712698 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:42.724365 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-8f359733-73f1-48d5-9d37-271a56d9b460 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:42.860117 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-8f359733-73f1-48d5-9d37-271a56d9b460 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139205 Jul 12 18:40:42.860622 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Jul 12 18:40:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:40:45.201421 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-ecb7f413-2c11-4091-a8a7-3dc3487182cf admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:40:45.202403 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-ecb7f413-2c11-4091-a8a7-3dc3487182cf admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 12 18:40:45.202779 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:40:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:40:45.797350 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5"}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:46.759024 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.550256 Jul 12 18:40:46.759818 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1282 bytes} [Tue Jul 12 18:40:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:40:46.773981 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-1421e66c-8c8a-4f76-a4ab-d1452a6a8b1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:40:46.895428 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-1421e66c-8c8a-4f76-a4ab-d1452a6a8b1c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126647 Jul 12 18:40:46.904238 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1332 bytes} [Tue Jul 12 18:40:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:41:06.017389 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:06.018356 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 12 18:41:06.018745 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:41:06.425184 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-939d5646-1653-4afe-851f-07362d70c850 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:06.442888 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-939d5646-1653-4afe-851f-07362d70c850 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.417382 Jul 12 18:41:06.443462 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Jul 12 18:41:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:07.519273 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:07.520413 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-a18a1822-6627-4d22-ada1-0590a3d42990 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 12 18:41:07.520808 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:08.051121 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-04a273dc-f792-48aa-9894-d96985090453 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:08.056906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.wsgi [None req-04a273dc-f792-48aa-9894-d96985090453 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-04a273dc-f792-48aa-9894-d96985090453 admin admin] Request method failure captured: Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept: application/json Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept-Encoding: gzip, deflate Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Connection: keep-alive Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Content-Length: 0 Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Host: 10.222.0.59 Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-System-Scope: None Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: User-Agent: python-novaclient Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Auth-Token: gAAAAABizcBDyDS-Bej9OUErpu6zYBwLeJr--pixc1ILibAdugdnoWFjkYnVywZ7vWICnMDaEMbkzdAMtFlIjpbcoNkm3ihB0yzBH1I0Jq4TXg18nYfcqCFXnww7_DZodTIsI7jzWkk1y6exbZK-aMoHoMj9kdZ-m2QPtiKmKlgTjlNtkdI-1NU Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Id: None Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Name: None Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Identity-Status: Confirmed Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Is-Admin-Project: True Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Id: default Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Name: Default Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Name: admin Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Role: admin,reader,member Jul 12 18:41:08.060208 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Roles: admin,reader,member Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant: admin Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Name: admin Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User: admin Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Id: default Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Name: Default Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Name: admin Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: method: > Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: exception: Flavor 42 could not be found. Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: action_args: {'id': '42'} Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:08.061974 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:08.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.064118 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-04a273dc-f792-48aa-9894-d96985090453 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:08.065364 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-04a273dc-f792-48aa-9894-d96985090453 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.398221 Jul 12 18:41:08.065364 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Jul 12 18:41:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:08.072099 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-565d7fd0-15f1-4746-8a38-c305aa245348 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:08.075017 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:41:08.093757 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-565d7fd0-15f1-4746-8a38-c305aa245348 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025878 Jul 12 18:41:08.094334 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:08.104810 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-e1eef7fd-9c5a-4c2c-abcb-67d1aba61d17 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:08.127064 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-e1eef7fd-9c5a-4c2c-abcb-67d1aba61d17 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025849 Jul 12 18:41:08.127641 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:41:08.137011 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-104b46a2-d315-40d8-b0c9-0a08ad1f55da admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:08.142944 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.wsgi [None req-104b46a2-d315-40d8-b0c9-0a08ad1f55da admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-104b46a2-d315-40d8-b0c9-0a08ad1f55da admin admin] Request method failure captured: Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept: application/json Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept-Encoding: gzip, deflate Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Connection: keep-alive Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Content-Length: 0 Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Host: 10.222.0.59 Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-System-Scope: None Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: User-Agent: python-novaclient Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Auth-Token: gAAAAABizcBDyDS-Bej9OUErpu6zYBwLeJr--pixc1ILibAdugdnoWFjkYnVywZ7vWICnMDaEMbkzdAMtFlIjpbcoNkm3ihB0yzBH1I0Jq4TXg18nYfcqCFXnww7_DZodTIsI7jzWkk1y6exbZK-aMoHoMj9kdZ-m2QPtiKmKlgTjlNtkdI-1NU Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Id: None Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Name: None Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Identity-Status: Confirmed Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Is-Admin-Project: True Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Id: default Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Name: Default Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Name: admin Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Role: admin,reader,member Jul 12 18:41:08.146170 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Roles: admin,reader,member Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant: admin Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Name: admin Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User: admin Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Id: default Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Name: Default Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Name: admin Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: method: > Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: exception: Flavor 42 could not be found. Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: action_args: {'id': '42'} Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:08.157513 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:08.158347 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:08.159452 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-104b46a2-d315-40d8-b0c9-0a08ad1f55da admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:08.160541 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-104b46a2-d315-40d8-b0c9-0a08ad1f55da admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014251 Jul 12 18:41:08.160541 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Jul 12 18:41:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 12 18:41:09.128201 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-e1eef7fd-9c5a-4c2c-abcb-67d1aba61d17 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:09.129212 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-e1eef7fd-9c5a-4c2c-abcb-67d1aba61d17 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 12 18:41:09.129603 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:09.658892 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-f8d4179e-f88e-4b44-abad-132e210cc207 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:09.664412 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.wsgi [None req-f8d4179e-f88e-4b44-abad-132e210cc207 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-f8d4179e-f88e-4b44-abad-132e210cc207 admin admin] Request method failure captured: Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept: application/json Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept-Encoding: gzip, deflate Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Connection: keep-alive Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Content-Length: 0 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Host: 10.222.0.59 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-System-Scope: None Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: User-Agent: python-novaclient Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Auth-Token: gAAAAABizcBF7oODCFJapbENhpe0eB4wKusLUYe-u2ti3Rmrymvb_ARCgiKm6ajKRHLya99yA9FwSmV_iAK6jH80_1kVxMAgYMmfh8GNQk2NuIscRBfQKvV7FlOcyKLaa6sr4XYz5da_DQZA9zH5PftHMLxAVZ3ldRf-0CaqTfOQT9GlBhJc9W0 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Id: None Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Name: None Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Identity-Status: Confirmed Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Is-Admin-Project: True Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Id: default Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Name: Default Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Name: admin Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Role: admin,reader,member Jul 12 18:41:09.665929 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Roles: admin,reader,member Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant: admin Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Name: admin Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User: admin Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Id: default Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Name: Default Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Name: admin Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: method: > Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: exception: Flavor 84 could not be found. Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: action_args: {'id': '84'} Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:09.667479 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:09.668461 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.669801 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-f8d4179e-f88e-4b44-abad-132e210cc207 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:09.671080 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-f8d4179e-f88e-4b44-abad-132e210cc207 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394012 Jul 12 18:41:09.671080 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Jul 12 18:41:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:09.677076 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-86a88939-a392-4cd0-8047-5d16983b0352 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:09.690987 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-86a88939-a392-4cd0-8047-5d16983b0352 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017516 Jul 12 18:41:09.691568 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:09.701983 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-13dd910d-e68d-4c49-b8ea-2d2f829ebac1 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:09.716204 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-13dd910d-e68d-4c49-b8ea-2d2f829ebac1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017817 Jul 12 18:41:09.716730 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:09.726040 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-92ab3a1f-abd9-41b3-8ce9-b1e7f8e6d788 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:09.731420 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.wsgi [None req-92ab3a1f-abd9-41b3-8ce9-b1e7f8e6d788 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-92ab3a1f-abd9-41b3-8ce9-b1e7f8e6d788 admin admin] Request method failure captured: Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept: application/json Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept-Encoding: gzip, deflate Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Connection: keep-alive Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Content-Length: 0 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Host: 10.222.0.59 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-System-Scope: None Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: User-Agent: python-novaclient Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Auth-Token: gAAAAABizcBF7oODCFJapbENhpe0eB4wKusLUYe-u2ti3Rmrymvb_ARCgiKm6ajKRHLya99yA9FwSmV_iAK6jH80_1kVxMAgYMmfh8GNQk2NuIscRBfQKvV7FlOcyKLaa6sr4XYz5da_DQZA9zH5PftHMLxAVZ3ldRf-0CaqTfOQT9GlBhJc9W0 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Id: None Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Name: None Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Identity-Status: Confirmed Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Is-Admin-Project: True Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Id: default Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Name: Default Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Name: admin Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Role: admin,reader,member Jul 12 18:41:09.732956 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Roles: admin,reader,member Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant: admin Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Name: admin Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User: admin Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Id: default Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Name: Default Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Name: admin Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: method: > Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: exception: Flavor 84 could not be found. Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: action_args: {'id': '84'} Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:09.734503 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:09.735423 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:09.736661 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-92ab3a1f-abd9-41b3-8ce9-b1e7f8e6d788 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:09.737939 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-92ab3a1f-abd9-41b3-8ce9-b1e7f8e6d788 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012006 Jul 12 18:41:09.737939 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Jul 12 18:41:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:10.736544 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-13dd910d-e68d-4c49-b8ea-2d2f829ebac1 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:10.737575 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-13dd910d-e68d-4c49-b8ea-2d2f829ebac1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 12 18:41:10.737957 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:11.269860 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-c2e850a9-9c5d-433c-9529-72899cebd402 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:11.275841 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.wsgi [None req-c2e850a9-9c5d-433c-9529-72899cebd402 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-c2e850a9-9c5d-433c-9529-72899cebd402 admin admin] Request method failure captured: Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept: application/json Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Accept-Encoding: gzip, deflate Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Connection: keep-alive Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Content-Length: 0 Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Host: 10.222.0.59 Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Openstack-System-Scope: None Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: User-Agent: python-novaclient Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Auth-Token: gAAAAABizcBGSEy-VIJKumxNqJmKqD3LUswYyAAlKvRdaFtipYw5Ttl0rgChVR7KiPocn0kxEfunZMT9cDzgQQ-PgCoGvbPOfynYoLzKEoYgRhR7ij5EaVza3wuFPH3a-Fop1fZBPPFgyphx0dsnytZmr-tYhE-1ejog0hgVaMUE1kEKliMKQwE Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Id: None Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Domain-Name: None Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Identity-Status: Confirmed Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Is-Admin-Project: True Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Id: default Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Domain-Name: Default Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Project-Name: admin Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Role: admin,reader,member Jul 12 18:41:11.277351 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Roles: admin,reader,member Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant: admin Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-Tenant-Name: admin Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User: admin Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Id: default Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Domain-Name: Default Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: X-User-Name: admin Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: method: > Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: exception: Flavor 451 could not be found. Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: action_args: {'id': '451'} Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:11.278858 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:11.279714 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.280751 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-c2e850a9-9c5d-433c-9529-72899cebd402 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110429) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:11.281755 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-c2e850a9-9c5d-433c-9529-72899cebd402 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.403612 Jul 12 18:41:11.281755 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:41:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:11.289040 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-3fba3ba6-429d-498e-aead-9bd9c91e450b admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:11.302703 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-3fba3ba6-429d-498e-aead-9bd9c91e450b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017973 Jul 12 18:41:11.304306 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:11.313611 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:11.328975 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018963 Jul 12 18:41:11.329501 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Jul 12 18:41:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:41:11.339045 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-075c62c8-00f4-4421-8eba-7e1f93653202 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:11.344389 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.wsgi [None req-075c62c8-00f4-4421-8eba-7e1f93653202 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-075c62c8-00f4-4421-8eba-7e1f93653202 admin admin] Request method failure captured: Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept: application/json Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Accept-Encoding: gzip, deflate Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Connection: keep-alive Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Content-Length: 0 Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Host: 10.222.0.59 Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-Api-Version: compute 2.90 Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Openstack-System-Scope: None Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: User-Agent: python-novaclient Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Auth-Token: gAAAAABizcBGSEy-VIJKumxNqJmKqD3LUswYyAAlKvRdaFtipYw5Ttl0rgChVR7KiPocn0kxEfunZMT9cDzgQQ-PgCoGvbPOfynYoLzKEoYgRhR7ij5EaVza3wuFPH3a-Fop1fZBPPFgyphx0dsnytZmr-tYhE-1ejog0hgVaMUE1kEKliMKQwE Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Id: None Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Domain-Name: None Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Identity-Status: Confirmed Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Is-Admin-Project: True Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Openstack-Nova-Api-Version: 2.90 Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Id: default Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Domain-Name: Default Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Project-Name: admin Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Role: admin,reader,member Jul 12 18:41:11.345882 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Roles: admin,reader,member Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_dad2e7d1aad04376b62040af65124d1e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/dad2e7d1aad04376b62040af65124d1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant: admin Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Id: dad2e7d1aad04376b62040af65124d1e Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-Tenant-Name: admin Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User: admin Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Id: default Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Domain-Name: Default Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Id: 29c25e261d9f41448e39bf8062b1ef57 Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: X-User-Name: admin Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: method: > Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: exception: Flavor 451 could not be found. Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: action_args: {'id': '451'} Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:41:11.347476 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:11.348599 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: ERROR nova.api.openstack.wsgi Jul 12 18:41:11.350379 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-075c62c8-00f4-4421-8eba-7e1f93653202 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110428) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:41:11.352163 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-075c62c8-00f4-4421-8eba-7e1f93653202 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011731 Jul 12 18:41:11.352163 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:41:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 12 18:41:12.327857 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:12.328862 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 12 18:41:12.329260 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:12.860038 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-ab0aec77-0fe2-4439-b64e-0e384de75756 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:41:12.940522 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-ab0aec77-0fe2-4439-b64e-0e384de75756 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.468164 Jul 12 18:41:12.941064 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Jul 12 18:41:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:41:13.919373 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:13.920421 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jul 12 18:41:13.920811 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:14.444486 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-daf712a8-7941-4db9-b25c-152ca2b6ff24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:41:14.534361 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-daf712a8-7941-4db9-b25c-152ca2b6ff24 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.477528 Jul 12 18:41:14.534908 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Jul 12 18:41:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:41:15.516465 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:15.517598 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jul 12 18:41:15.517988 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:16.050875 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-2ced2f08-5f3c-4be1-875d-54be9277b1e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:41:16.118120 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-2ced2f08-5f3c-4be1-875d-54be9277b1e7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.463600 Jul 12 18:41:16.118660 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Jul 12 18:41:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:41:17.094042 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:17.095031 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 12 18:41:17.095492 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:17.623706 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-8cf1da4d-7360-4bf7-b656-0dac5764980b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:41:17.678261 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-8cf1da4d-7360-4bf7-b656-0dac5764980b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.444158 Jul 12 18:41:17.678798 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Jul 12 18:41:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:41:18.646340 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:18.648419 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002463 Jul 12 18:41:18.648819 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:41:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:41:19.179128 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-4f5313ae-8522-4e22-b961-0b011046d206 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:41:19.198656 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-4f5313ae-8522-4e22-b961-0b011046d206 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.409999 Jul 12 18:41:19.199202 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Tue Jul 12 18:41:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:42:12.019826 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.021636 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-d2e5d0b8-8600-4205-8c97-62d48a0e6d03 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002267 Jul 12 18:42:12.022030 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 930 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:42:12.032955 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.445395 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-dbeb6bd6-4a64-4aca-bca3-a9069a154aa4 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.464788 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-dbeb6bd6-4a64-4aca-bca3-a9069a154aa4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.436359 Jul 12 18:42:12.465338 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1291 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:42:12.486510 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG dbcounter [-] [110429] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110429) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:42:12.490561 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-4c0e2809-533a-440f-bee9-bd13792267e0 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.498595 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-4c0e2809-533a-440f-bee9-bd13792267e0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013475 Jul 12 18:42:12.501837 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1282 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:12.511319 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-e70ef5cc-1512-414d-8144-c3787081269f admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.519478 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-e70ef5cc-1512-414d-8144-c3787081269f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011609 Jul 12 18:42:12.520020 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1285 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:12.532567 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.540647 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012012 Jul 12 18:42:12.541166 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1285 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:42:12.553196 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-433b976f-d9a1-40c3-b3ec-b38a53ed956d admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:42:12.560908 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-433b976f-d9a1-40c3-b3ec-b38a53ed956d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011949 Jul 12 18:42:12.561431 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1282 bytes} [Tue Jul 12 18:42:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:45:46.825149 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:46.826154 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 12 18:45:46.826549 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:45:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:45:46.974711 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_api:SELECT=6 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:47.135821 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:47.137040 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:45:47.137040 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:45:47.138228 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:47.138653 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:47.139453 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:47.139873 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:47.176509 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-166b079a-08ac-4120-97ae-7f45d612ec01 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201442 Jul 12 18:45:47.176509 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:45:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:45:48.000103 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:48.001123 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 12 18:45:48.001501 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:45:48.198622 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:48.199855 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:45:48.199855 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:45:48.201052 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:48.201495 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:48.202280 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:48.202714 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:48.222958 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-81c4b162-0502-407b-810a-76d0389340fb admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.079189 Jul 12 18:45:48.224282 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:45:48 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:45:59.486211 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:59.487211 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 12 18:45:59.487635 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:45:59.632570 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_cell0:SELECT=4 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:59.633356 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_cell1:SELECT=4 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:59.633875 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG dbcounter [-] [110428] Writing DB stats nova_api:SELECT=8 {{(pid=110428) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:45:59.683081 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:45:59.684266 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:45:59.684266 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:45:59.687612 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:59.687612 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:59.687612 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:45:59.687612 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:45:59.714898 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-c37834df-e280-4235-8b07-f882511f9bd0 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086542 Jul 12 18:45:59.714898 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:45:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:46:00.539245 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: DEBUG nova.api.openstack.wsgi [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] Calling method '>' {{(pid=110429) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:46:00.540309 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: INFO nova.api.openstack.requestlog [None req-fa34edaf-3f7c-4cc4-a5da-d8ee8052c114 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 12 18:46:00.540896 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: [pid: 110429|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Jul 12 18:46:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:46:00.732105 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG nova.api.openstack.wsgi [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] Calling method '>' {{(pid=110428) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:46:00.733444 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:46:00.733444 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: warnings.warn(msg) Jul 12 18:46:00.734679 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:46:00.735117 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:46:00.735950 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:46:00.736382 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: DEBUG oslo_concurrency.lockutils [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110428) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:46:00.758330 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: INFO nova.api.openstack.requestlog [None req-9f22b9b7-32aa-4d3c-8ef1-739b86300d47 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077863 Jul 12 18:46:00.758811 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: [pid: 110428|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Jul 12 18:46:00 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:46:58.163119 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: Tue Jul 12 18:46:58 2022 - graceful shutdown triggered... Jul 12 18:46:58.163027 dv-cinder-835384-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 12 18:46:58.164196 dv-cinder-835384-15-iscsi devstack@n-api.service[110428]: Gracefully killing worker 1 (pid: 110428)... Jul 12 18:46:58.164572 dv-cinder-835384-15-iscsi devstack@n-api.service[110429]: Gracefully killing worker 2 (pid: 110429)... Jul 12 18:46:59.164102 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: worker 1 buried after 1 seconds Jul 12 18:46:59.164683 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: worker 2 buried after 1 seconds Jul 12 18:46:59.164683 dv-cinder-835384-15-iscsi devstack@n-api.service[110427]: goodbye to uWSGI. Jul 12 18:46:59.165727 dv-cinder-835384-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 12 18:46:59.166298 dv-cinder-835384-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 12 18:46:59.169153 dv-cinder-835384-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 12 18:46:59.178991 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 12 18:46:59.181589 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:46:59 2022] *** Jul 12 18:46:59.181747 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:46:59.181879 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:46:59.181995 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: nodename: dv-cinder-835384-15-iscsi Jul 12 18:46:59.182121 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: machine: x86_64 Jul 12 18:46:59.182233 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: clock source: unix Jul 12 18:46:59.182348 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: pcre jit disabled Jul 12 18:46:59.182460 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: detected number of CPU cores: 4 Jul 12 18:46:59.182575 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: current working directory: / Jul 12 18:46:59.182691 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:46:59.182824 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: your processes number limit is 47680 Jul 12 18:46:59.182824 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: your memory page size is 4096 bytes Jul 12 18:46:59.182824 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: detected max file descriptor number: 2048 Jul 12 18:46:59.182824 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: lock engine: pthread robust mutexes Jul 12 18:46:59.183146 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: thunder lock: enabled Jul 12 18:46:59.183217 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 12 18:46:59.183292 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:46:59.228191 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: Python main interpreter initialized at 0x557dfb91c9c0 Jul 12 18:46:59.228191 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: python threads support enabled Jul 12 18:46:59.228191 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: your server socket listen backlog is limited to 100 connections Jul 12 18:46:59.228191 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:46:59.228596 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:46:59.228688 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: *** Operational MODE: preforking *** Jul 12 18:46:59.228951 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:46:59.228951 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: spawned uWSGI master process (pid: 124952) Jul 12 18:46:59.229162 dv-cinder-835384-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 12 18:46:59.229765 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: spawned uWSGI worker 1 (pid: 124970, cores: 1) Jul 12 18:46:59.230282 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: spawned uWSGI worker 2 (pid: 124971, cores: 1) Jul 12 18:46:59.230505 dv-cinder-835384-15-iscsi devstack@n-api.service[124952]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:46:59.902219 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:46:59.920241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 12 18:47:01.112181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:47:01.112181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: from cryptography.utils import int_from_bytes Jul 12 18:47:01.112798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:47:01.112798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: from cryptography.utils import int_from_bytes Jul 12 18:47:01.154379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:47:01.154379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: from cryptography.utils import int_from_bytes Jul 12 18:47:01.154983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:47:01.154983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: from cryptography.utils import int_from_bytes Jul 12 18:47:03.451439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:47:03.452434 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:47:03.453199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:47:03.453801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:47:03.454267 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:47:03.454890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.455475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.456071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.456618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.457171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.457704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.458404 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.459085 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.459828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.460436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.460912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.461413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-15-iscsi {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.461921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.462395 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.462941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.463461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.463944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.464439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.464926 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.465719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.466210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.466813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.467284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.467826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.468321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.468794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.469288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.469772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.470264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.470745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.471338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-15-iscsi {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.471818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.472293 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.472785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.473382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.473858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.474327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.475488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.476095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.476593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.477105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.477594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.478086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.478579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.479055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.479563 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.480057 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.480548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.481025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.481495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.481906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.482388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.482871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.483385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.483883 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.484296 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.484713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.485222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.485718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.486201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.486669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.487136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.487656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.488126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.488610 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.489079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.489549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.490027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.491179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.491697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.492190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.492681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.493249 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.493671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.494154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.494675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.495443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.495926 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.496415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.496897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.497377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.497859 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.498332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.498820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.499349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.499831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.500249 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.500718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.501186 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.501674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.502150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.502633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.503113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.503599 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.504066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.504548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.505025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.505586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.506094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.506560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.507026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.507532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.508014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.508517 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.509007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.509482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.509962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.510429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.510906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.511449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.511929 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.512406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.512906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.513385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.513862 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.514341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.514808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.515271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.515785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.516254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.516730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.517252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.517722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.518196 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.518674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.519139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.519634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.524444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.525596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.528611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.530813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.531038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.531325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.531647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.531979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.532375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.532671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.532993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.533312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.533642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.534016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.534335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.534660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.534984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.535322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.535642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.535961 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.536281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.536624 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.536947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.537861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.538189 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.538515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.538618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:47:03.539024 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.539108 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:47:03.539181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.539646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.539857 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.540045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:47:03.540222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.540368 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:47:03.540523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.540675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:47:03.540828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.540971 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.541114 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.541268 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.541437 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.541593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.541744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.541888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.542039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.542192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.542368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.542527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.542678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.542829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.543002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.543163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.543339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.543518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.543671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.543815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.543965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.544117 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.544261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.544403 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-15-iscsi {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.544557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.544712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.544862 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.545020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.545171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.545325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.545475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.545618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.546371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.546526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.546672 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.546816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.546958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.547100 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.547257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.547257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.547578 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.547754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.547906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.548064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.548221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.548364 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.548506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.548661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.548813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.548971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.549114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.549263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.549405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.549559 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.549702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.549855 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.550004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.550146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.550302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.550453 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.550607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.550764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.550915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-15-iscsi {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.551058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.551212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.551374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.551550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.551694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.551833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.551946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.552056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.552176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.552290 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.552406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.552601 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.552721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.552962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.553577 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.553764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.554077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.554194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.554386 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.554506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.554727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.554863 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.555038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.555197 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.555409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.555554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.557184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.557345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.557502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.557657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.557810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.557968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.558150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.558308 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.558468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.558673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.558865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.559022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.559166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.559420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.559603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.559804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.559965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.560124 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.560277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.560430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.560588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.560739 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.560895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.561058 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.561214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.561380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.561380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.561697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.561846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.562004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.562154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.562303 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.562454 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.562610 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.562765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.562923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.563080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.563230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.563405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.563568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.563728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.563887 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.564045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.564202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.564350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.564508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.564669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.564818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.564818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.565118 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.565274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.565424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.565602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.565768 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.565952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.566708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.566879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.567031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.567197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.567398 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.567567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.567727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.567884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.568041 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.568206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.568370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.568592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.568751 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.568901 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.569050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.569209 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.569367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.569525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.569674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.569831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.569989 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.570139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.570299 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.570455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.570605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.570762 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.570928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.571086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.571234 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.571234 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.571557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.571717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.571877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.572035 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.572192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.572362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.572512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.572660 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.572824 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.572983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.573140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.573290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.573438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.573638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.573845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.574001 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.574150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.574307 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.574468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.574632 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.574791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.574949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.575105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.575253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.575461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.575630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.575787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.575945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.576095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.576095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.577033 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.577211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.577370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.577565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.577733 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.577884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.578047 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.578205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.578354 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.578502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.578661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.578811 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.578968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.579126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.579287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.579287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.579777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.579934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.580091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.580250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.580400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.580400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.580700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.580859 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.581008 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.581166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.581325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.581495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.581646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.581795 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.581970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.582313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.582478 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.582637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.582798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.582955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.583106 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.583263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.583451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.584218 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.584383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.584620 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.585294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.585294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.585610 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.585761 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.585944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.586183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.586377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.587170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.587444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.587606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.587766 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.587917 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.588064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.588185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.588297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.588451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.588578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.588700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.588820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.588941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.589060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.589173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.589298 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.589410 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.589529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.589650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.589781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.589781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590088 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.590208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:47:03.590430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590540 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.590893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.591009 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.591120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.591229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.591771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.591939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592390 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.592870 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593318 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.593938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594250 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.594884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595200 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.595858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.596018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.596169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.596318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.596473 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.597272 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.597452 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.597624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.597783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.597941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598414 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.598964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599225 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599520 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599520 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599520 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.599520 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600219 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.600918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601354 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.601916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602084 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.602945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603758 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.603948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604142 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604327 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604503 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.604914 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605474 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.605926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606145 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606290 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.606915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607198 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607563 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.607882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608107 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.608828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609132 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609356 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609450 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609758 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.609976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.610080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.610299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.610615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.610709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.610927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611238 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.611987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612299 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612621 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.612941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613252 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613570 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613786 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.613887 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614190 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614501 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614721 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.614821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.615066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.615236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.615504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.615666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.615845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.616027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.616328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.616491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.616652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.616797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.617016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.617338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.617637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.617785 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.617924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618358 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618792 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.618962 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619839 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.619978 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.620962 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621654 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.621972 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622403 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622632 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.622947 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.623062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.623872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.623969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.624854 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.625054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.625377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.625468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.625708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.625799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.626789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.627014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.627135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.628940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629256 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629419 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629571 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.629973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630275 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.630924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.631241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.631441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.631790 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.631896 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632434 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.632953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.633837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634412 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.634852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.635041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.635134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.635386 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.635713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.636035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.636312 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.636450 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.636669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.636859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637384 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.637941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638255 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638427 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638763 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.638914 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639340 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.639948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640259 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.640881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641754 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.641856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642416 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.642833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.643816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644750 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.644996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645312 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645626 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.645951 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.646051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.646271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.646372 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.647093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.647289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.647568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.647871 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.647990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.648237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.648339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.648566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.648663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.648936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649367 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649690 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.649910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.650973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651182 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651276 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651627 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651837 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.651938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.652168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.652260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.652486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.652608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.652855 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653307 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.653818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654450 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.654990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.655994 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656400 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.656950 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.657890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658036 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.658900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659546 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659767 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.659876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660180 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.660814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.661968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.662060 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.662838 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.662945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.663351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.663468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.663704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.663861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664187 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664644 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.664967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665329 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.665976 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666517 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666609 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.666928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667233 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667478 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.667891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.668855 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.669799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670632 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.670942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671374 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671601 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671715 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.671912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672015 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672323 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672537 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672643 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672849 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.672940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.673157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.673258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.673473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.673568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.673783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674032 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674474 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.674999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675360 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.675971 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.676910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677324 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.677996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.678208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.678390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.678544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.678860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.678986 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679542 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679858 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.679967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.680969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681180 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.681903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682433 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682734 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.682836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683419 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683689 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.683999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.684960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685063 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.685914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686234 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686758 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.686857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687172 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687580 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687789 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.687909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.688814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.689953 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690266 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690367 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690574 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.690902 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691003 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691218 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.691959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.692180 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.692271 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.692492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.692717 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.692819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693399 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693522 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.693934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694559 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.694980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695660 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.695964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696198 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.696923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.697902 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698085 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698189 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.698835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699699 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.699853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700305 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.700926 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701412 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.701995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702307 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702626 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702789 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.702938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703248 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703453 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703585 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.703889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.704866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705081 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705494 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.705835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706207 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.706780 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.707923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708785 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.708953 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.709617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.709754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.709979 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.710122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.710361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.710543 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.710684 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.710886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.711976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712199 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712624 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.712934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713158 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713263 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713572 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713786 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.713878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714199 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714723 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.714822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.715838 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716162 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716372 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.716776 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717311 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717624 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.717940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.718873 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719351 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719541 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.719906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.720980 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721752 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.721893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722065 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.722800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723359 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.723980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.724130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.724315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.724469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.724617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.725338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.725496 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.725678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.725821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.726098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.726417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.726556 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.726726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.726875 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727384 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.727806 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728407 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.728936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729034 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729243 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.729992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.730170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.730315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.730477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.730785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.730922 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731240 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731720 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.731850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732022 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732123 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732426 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.732967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733304 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733616 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.733941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.734995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.735222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.735357 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.735578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.735669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.735897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736003 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.736949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.737889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738199 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.738824 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.739054 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.739154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.739386 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.739630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.739737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740036 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.740861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.741915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742029 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742556 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.742978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.743978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.744971 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.745456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.745550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.745778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.745879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746100 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746574 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746785 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.746880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.747884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.748017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:47:03.748111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.748395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.748726 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.749029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.749351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.749666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.749984 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.750305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.750628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.750960 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.751316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.751655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.752008 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.752298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.752606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.753167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.753487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.753825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.754158 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.754488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.754811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.755135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.755504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.755819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.756606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.757186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.757513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.757833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.758169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.758496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.758814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.759147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.759495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.760095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.760455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.760781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.761118 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.761452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.761778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.762152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.762424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.762740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.763056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.763411 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.763735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.764052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.764368 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.764694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.765013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.765328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.765652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.765967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.766306 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.766620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.766931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.767243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.767589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.767904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.768217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.768531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.768843 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.769167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.769476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.769796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.770105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.770423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.770733 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.771049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.771445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.772797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.773355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.773682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.774020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.774345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.774681 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.775004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.775431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.775716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.776044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.776653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.776997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.777324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.777675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.778015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.778383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.778645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.778961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.779330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.779633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.780017 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.780266 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.780587 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.780911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.781228 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.781545 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.781861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.782178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.782494 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.782808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.783124 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.783468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.783796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.784157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.784489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.784818 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.785141 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.785466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.785787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.786104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.786424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.786741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.787067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.787496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.788005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.788570 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.789023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.789349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.789682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.790011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.790367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.790665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.790999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.791343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.791672 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.791995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.792330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.792678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.793012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.793344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.793656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.793968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.794282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.794600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.794926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.795245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.795582 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.795892 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.796210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.796527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.796837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.797147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.797459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.797774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.798082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.798393 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.798705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.799015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.799350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.799767 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.799977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.800291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.800604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.800913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.801226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.801538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.801888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.802226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.802548 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.803453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.804002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.804349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.804671 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.805002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.805332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.805661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.805979 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.806318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.806635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.806961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.807278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.807617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.807934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.808251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.808593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.808926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.809239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.809572 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.809902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.810231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.810554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.811477 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.811477 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.811794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.811936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.812167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.812488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.812808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.813132 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.813456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.813793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.814124 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.814443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.814778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.815114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.815507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.815828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.816184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.816519 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.816848 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.817168 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.817480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:47:03.817732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:47:03.902058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO dbcounter [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Registered counter for database nova_api Jul 12 18:47:03.924433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_db.sqlalchemy.engines [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:03.931958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writer thread running {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:03.972404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO dbcounter [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Registered counter for database nova_api Jul 12 18:47:03.988502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.context [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35fbcab1-4fbf-4d9a-acd5-685fb6ee233f(cell1) {{(pid=124971) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:47:03.992829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:47:03.993003 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_db.sqlalchemy.engines [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:03.994478 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:47:03.995569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:47:03.997616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:47:03.999632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO dbcounter [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Registered counter for database nova_cell0 Jul 12 18:47:04.000292 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writer thread running {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.003634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO dbcounter [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Registered counter for database nova_cell1 Jul 12 18:47:04.011704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_db.sqlalchemy.engines [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.013477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_db.sqlalchemy.engines [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.019025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writer thread running {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.021723 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writer thread running {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.057492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.context [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),35fbcab1-4fbf-4d9a-acd5-685fb6ee233f(cell1) {{(pid=124970) load_cells /opt/stack/nova/nova/context.py:464}} Jul 12 18:47:04.061467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:47:04.063092 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:47:04.064066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:47:04.066038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:47:04.068094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO dbcounter [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Registered counter for database nova_cell0 Jul 12 18:47:04.072731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO dbcounter [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Registered counter for database nova_cell1 Jul 12 18:47:04.080265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_db.sqlalchemy.engines [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.081650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_db.sqlalchemy.engines [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.089209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writer thread running {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.092052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writer thread running {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.167040 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO dbcounter [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Registered counter for database nova_cell0 Jul 12 18:47:04.174346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_db.sqlalchemy.engines [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.182893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writer thread running {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.246191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO dbcounter [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Registered counter for database nova_cell0 Jul 12 18:47:04.253613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_db.sqlalchemy.engines [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:47:04.259614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writer thread running {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:47:04.516470 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: WARNING keystonemiddleware.auth_token [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:47:04.524580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: WARNING keystonemiddleware.auth_token [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:47:04.607642 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: WARNING keystonemiddleware.auth_token [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:47:04.615103 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: WARNING keystonemiddleware.auth_token [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:47:04.871955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: WARNING keystonemiddleware.auth_token [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:47:04.878235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: WARNING keystonemiddleware.auth_token [None req-453259f4-6ea7-40b1-a9fc-d4d5c2a0a023 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:47:04.883970 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557dfb91c9c0 pid: 124971 (default app) Jul 12 18:47:04.976990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: WARNING keystonemiddleware.auth_token [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 12 18:47:04.982980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: WARNING keystonemiddleware.auth_token [None req-a03decb4-387c-439d-a849-3cfae0c0ee86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 12 18:47:04.988323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557dfb91c9c0 pid: 124970 (default app) Jul 12 18:47:47.388475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:47.390633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:47.391747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:47.392915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:48.188358 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:48.190125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:48.191096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:48.195952 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:47:48.782309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-66e02c7a-97cf-467a-a008-433f520932a8 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Action: 'create', calling method: .version_select at 0x7f017a446700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1123331636"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:47:49.519558 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-60f7ad76-3105-4a46-833c-8ed79531a776 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Action: 'create', calling method: .version_select at 0x7f017a4465e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2077616032", "metadata": {"Type": "work"}}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:47:52.168314 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-66e02c7a-97cf-467a-a008-433f520932a8 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.793775 Jul 12 18:47:52.169280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1154 bytes} [Tue Jul 12 18:47:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4796 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 12 18:47:52.183437 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bb4039a6-211d-4aec-9ab8-e72ec5b611d4 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30a550>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:52.258396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-60f7ad76-3105-4a46-833c-8ed79531a776 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.075774 Jul 12 18:47:52.281564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Jul 12 18:47:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4101 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 12 18:47:52.292181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-56eaf34f-1084-4160-aaa2-95654d70a043 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a30a4c0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:52.415445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bb4039a6-211d-4aec-9ab8-e72ec5b611d4 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 200 len: 345 microversion: 2.1 time: 0.238130 Jul 12 18:47:52.416202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:52 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 345 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:47:52.573681 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-56eaf34f-1084-4160-aaa2-95654d70a043 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 200 len: 353 microversion: 2.1 time: 0.289359 Jul 12 18:47:52.582756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:52 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:53.439925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8476a6d1-d303-4f0b-96b9-0b05e1eb0002 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30a670>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:53.586145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8476a6d1-d303-4f0b-96b9-0b05e1eb0002 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 200 len: 345 microversion: 2.1 time: 0.158870 Jul 12 18:47:53.586145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:53 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:53.587167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6aa09c8d-896f-4cfc-ac82-6ef178f1ee42 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a30a700>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:53.727245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6aa09c8d-896f-4cfc-ac82-6ef178f1ee42 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 200 len: 353 microversion: 2.1 time: 0.138785 Jul 12 18:47:53.729608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:53 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:54.597570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b273d4aa-40e7-4043-bc67-d78d780913b8 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30aca0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:54.702911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b273d4aa-40e7-4043-bc67-d78d780913b8 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 200 len: 346 microversion: 2.1 time: 0.109608 Jul 12 18:47:54.704202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:54 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 346 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:54.716134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-660ae828-5031-4842-a1cc-1c59b31ece04 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Action: 'create', calling method: .version_select at 0x7f017a30ab80>, body: {"snapshot": {"volume_id": "e3bbe078-2bd2-460f-8728-5e7861e9cf02", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1416310865"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:47:54.744504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d777f373-352b-4d34-b962-e996564ee7a6 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a3233a0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:55.237361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d777f373-352b-4d34-b962-e996564ee7a6 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 200 len: 354 microversion: 2.1 time: 0.499614 Jul 12 18:47:55.251099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 5/8] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:54 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 354 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:55.260020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8a337ba0-79e7-4e44-9f87-5c444ad2457c tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a30ad30>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:55.603775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8a337ba0-79e7-4e44-9f87-5c444ad2457c tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 200 len: 354 microversion: 2.1 time: 0.350792 Jul 12 18:47:55.612784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 6/9] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:55 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 354 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:55.629953 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fb10a284-7928-4bd1-a142-8fea46c8a3bd tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a30a790>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:55.915880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fb10a284-7928-4bd1-a142-8fea46c8a3bd tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 202 len: 0 microversion: 2.1 time: 0.294428 Jul 12 18:47:55.915880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 7/10] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:47:55 2022] DELETE /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:47:55.919098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-660ae828-5031-4842-a1cc-1c59b31ece04 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.204030 Jul 12 18:47:55.929613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 4/11] 10.222.0.59 () {60 vars in 1161 bytes} [Tue Jul 12 18:47:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:55.931204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-909f57c9-8bba-4de4-acb5-150525267f53 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a3234c0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:55.936784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-68f85600-8c68-48a6-a0d9-aa9751928713 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a321820>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:56.048474 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-68f85600-8c68-48a6-a0d9-aa9751928713 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.117108 Jul 12 18:47:56.049531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 5/12] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:47:55 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:47:56.059985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-84fce75a-0da6-4931-8299-db5d5d729257 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30adc0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:56.111370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-909f57c9-8bba-4de4-acb5-150525267f53 tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 200 len: 353 microversion: 2.1 time: 0.191692 Jul 12 18:47:56.112211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 8/13] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:55 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:47:56.164204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-84fce75a-0da6-4931-8299-db5d5d729257 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.108977 Jul 12 18:47:56.170375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 6/14] 10.222.0.59 () {58 vars in 1139 bytes} [Tue Jul 12 18:47:56 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:56.177788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-465c979b-58fa-43e2-86a1-004c70a3c042 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30a670>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:56.310837 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-465c979b-58fa-43e2-86a1-004c70a3c042 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.138336 Jul 12 18:47:56.311507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 9/15] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:47:56 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:57.125115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d875de41-884a-4cb6-a21f-fdd18affd7cc tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Calling method '.version_select at 0x7f017a321940>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:57.165286 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-d875de41-884a-4cb6-a21f-fdd18affd7cc tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] HTTP exception thrown: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d875de41-884a-4cb6-a21f-fdd18affd7cc tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Request method failure captured: Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f HTTP/1.1 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHU1ZXGPaEwfQypabmfHJI9muSQVrKeRwC2ztrJwrM1MTBjPPIrmK6s9IOUynuBT27k8Uk6uGr9ucNVsy3U7t-FBYzxyibCBY5dOMNr5rACBQ9PFwdGz2RB0Mgaom7O8PpbceUzkNMIA30mlhZI6rXhzA9rdNGJmRMBmPoBJOrwCBw Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: e945991092864139baa9c052f5692be8 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesGetTestJSON-257331646 Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:47:57.169906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e945991092864139baa9c052f5692be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e945991092864139baa9c052f5692be8", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e945991092864139baa9c052f5692be8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e945991092864139baa9c052f5692be8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesGetTestJSON-257331646 Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: e945991092864139baa9c052f5692be8 Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesGetTestJSON-257331646 Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesGetTestJSON-257331646-project Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 5736b68136704475bd39d967cb765fe9 Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesGetTestJSON-257331646-project Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '71009951-8edc-46dd-9561-eebb6f24209f'} Jul 12 18:47:57.171326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. (HTTP 404) (Request-ID: req-0a8d647d-a9c0-47b5-a346-159e592da3ad) Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:47:57.172196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:47:57.173392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:47:57.174445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. Jul 12 18:47:57.175603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:47:57.177082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d875de41-884a-4cb6-a21f-fdd18affd7cc tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] Returning 404 to user: Volume 71009951-8edc-46dd-9561-eebb6f24209f could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:47:57.180392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d875de41-884a-4cb6-a21f-fdd18affd7cc tempest-VolumesGetTestJSON-257331646 tempest-VolumesGetTestJSON-257331646-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f" status: 404 len: 109 microversion: 2.1 time: 0.059172 Jul 12 18:47:57.181493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 7/16] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:47:57 2022] GET /compute/v2.1/os-volumes/71009951-8edc-46dd-9561-eebb6f24209f => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:47:57.323175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a59e310d-c1e4-4eec-8058-bc72d3adce42 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a30ad30>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:57.390253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a59e310d-c1e4-4eec-8058-bc72d3adce42 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.070892 Jul 12 18:47:57.390838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 10/17] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:47:57 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:47:58.405654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ed6ac4a3-79ea-4c25-ad9b-9e8b23208252 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a323550>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:58.449755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1556116100", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "networks": [{"uuid": "d25a2909-7ae4-4023-bcad-bc9108c980e6"}]}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:47:58.464381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ed6ac4a3-79ea-4c25-ad9b-9e8b23208252 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.065121 Jul 12 18:47:58.465165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 11/18] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:47:58 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:47:58.725250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] validate_networks() for [('d25a2909-7ae4-4023-bcad-bc9108c980e6', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:47:59.491479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-31e7c08c-3094-4478-8f7e-c21733f208ee tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a323c10>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:47:59.542328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-31e7c08c-3094-4478-8f7e-c21733f208ee tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.070370 Jul 12 18:47:59.548925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 12/19] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:47:59 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:48:00.565569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7d2b7f6c-cf7f-4016-8c2a-0e88d8122855 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a323e50>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:00.614374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7d2b7f6c-cf7f-4016-8c2a-0e88d8122855 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.057254 Jul 12 18:48:00.615143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 13/20] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:48:00 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:48:01.170326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:48:01.170846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:48:01.176878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:48:01.176878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:48:01.176878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:48:01.209555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:01.210614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:01.213854 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:01.214502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:01.331911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Getting quotas for project 72abacc31aec413ab443150dcdf1bdce. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:48:01.352037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Getting quotas for user 3687d8518bec45a08e1682d8675ca7c1 and project 72abacc31aec413ab443150dcdf1bdce. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:48:01.393080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:48:01.399678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:48:01.563536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-95e1cd36-9d7e-441f-96cc-0d041c67e55e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: .version_select at 0x7f017a323670>, body: {"keypair": {"name": "tempest-keypair-82221613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOxTYAPBYsLaYTOU7f6NWoY9wnE9crT/YAdRVtA1l5Lz9ZmbE1ZEfb/eIJ86oetQqtHRclel6HhIi3BVYbpL1VdHKFESsVt1S9Q1LASsHQHH6hqMdDllxk5GQDfqiXjxQ=="}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:01.681055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-014e8d2e-a5b6-40d5-9e18-c2f434e7644a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.688540 Jul 12 18:48:01.682224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 8/21] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:47:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:48:01.696336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-95e1cd36-9d7e-441f-96cc-0d041c67e55e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for project 2b14300d453444a582d224fcee029d2d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:48:01.702995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b5c3b3b9-d80d-43d7-ae55-7c363afd06a3 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f01799901f0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:01.711293 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-95e1cd36-9d7e-441f-96cc-0d041c67e55e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for user 26993e3a077449da9c71fa7f1023a1e7 and project 2b14300d453444a582d224fcee029d2d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:48:01.787239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b5c3b3b9-d80d-43d7-ae55-7c363afd06a3 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.101227 Jul 12 18:48:01.790497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 9/22] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:48:01 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:01.808686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f7147d61-fba9-46b7-8154-c1f27e9f4a6d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:01.816825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f7147d61-fba9-46b7-8154-c1f27e9f4a6d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:01.949458 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-95e1cd36-9d7e-441f-96cc-0d041c67e55e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.216760 Jul 12 18:48:01.949458 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 14/23] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:48:00 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:48:02.077863 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f7147d61-fba9-46b7-8154-c1f27e9f4a6d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:02.132142 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f7147d61-fba9-46b7-8154-c1f27e9f4a6d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1215 microversion: 2.1 time: 0.338639 Jul 12 18:48:02.143069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 10/24] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:01 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:02.803197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-23abcd8c-39c7-409e-b176-44dac4af8763 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a27cc10>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:02.875971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-23abcd8c-39c7-409e-b176-44dac4af8763 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 288 microversion: 2.1 time: 0.071186 Jul 12 18:48:02.875971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 15/25] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:48:02 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 288 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:02.882807 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-40a72015-2aeb-499d-9687-d2d896dbc3f7 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017999dca0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:03.073682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-40a72015-2aeb-499d-9687-d2d896dbc3f7 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 202 len: 0 microversion: 2.1 time: 0.196569 Jul 12 18:48:03.074375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 11/26] 10.222.0.59 () {58 vars in 1253 bytes} [Tue Jul 12 18:48:02 2022] DELETE /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:48:03.083655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d6a4a9f2-9c3f-4240-8ed1-c5e20a1a54db tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a27c5e0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:03.137726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d6a4a9f2-9c3f-4240-8ed1-c5e20a1a54db tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 200 len: 287 microversion: 2.1 time: 0.059005 Jul 12 18:48:03.138308 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 16/27] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:48:03 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:03.152560 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1e2fc48b-1755-4c99-b776-a441b35360c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:03.153330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1e2fc48b-1755-4c99-b776-a441b35360c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:03.279388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1e2fc48b-1755-4c99-b776-a441b35360c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:03.294507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1e2fc48b-1755-4c99-b776-a441b35360c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1215 microversion: 2.1 time: 0.145240 Jul 12 18:48:03.306840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 12/28] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:03 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:04.257345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e34d406f-0627-4bcd-8618-7a13d8571664 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Action: 'create', calling method: .version_select at 0x7f017a2ad0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-476058225", "metadata": {"Type": "work"}}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e34d406f-0627-4bcd-8618-7a13d8571664 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 121 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:04.288233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-476058225", "metadata": {"Type": "work"}}} Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:04.289580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-476058225', 'metadata': {'Type': 'work'}}}} Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi '#$%' Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:04.290335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:48:04.291731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:48:04.292936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 12 18:48:04.292936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.292936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e34d406f-0627-4bcd-8618-7a13d8571664 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:04.292936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e34d406f-0627-4bcd-8618-7a13d8571664 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.823753 Jul 12 18:48:04.292936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 17/29] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Jul 12 18:48:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 825 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 12 18:48:04.310568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a8626eb5-8e3b-481b-84c0-ce048147b718 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017a2ad670>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:04.365915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-a8626eb5-8e3b-481b-84c0-ce048147b718 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] HTTP exception thrown: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a8626eb5-8e3b-481b-84c0-ce048147b718 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Request method failure captured: Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 HTTP/1.1 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHT5NYE5apQO3Z-HpowSMtCfHtBCNx6O3nbfNsxuqdBKxuYwW_qEXIgbpYs_-UtclpqbCMH9yqU9ho7CbDv4C0wruETcD1e6XjUGXjxrLukJ3IHmCuVpk-ZEdh_Yz4r-GDar0wiuEg54f9VQJyjWnqJyMyqvFWiPoA0EuSvM3UYUHY Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:04.372623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_215e56b9a1ff4aa5bd871e16945acae8", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: ad040b4a44244dec892176bb62b57023 Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'c0e5d456-c4c9-405b-bed0-a9910be896d7'} Jul 12 18:48:04.374020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. (HTTP 404) (Request-ID: req-0d131675-5d3c-4136-872b-47d6efe0e168) Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.374844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:04.376160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 12 18:48:04.377338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. Jul 12 18:48:04.378577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.385608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a8626eb5-8e3b-481b-84c0-ce048147b718 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Returning 404 to user: Snapshot c0e5d456-c4c9-405b-bed0-a9910be896d7 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:04.385608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a8626eb5-8e3b-481b-84c0-ce048147b718 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7" status: 404 len: 111 microversion: 2.1 time: 0.089387 Jul 12 18:48:04.385608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 18/30] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 18:48:04 2022] GET /compute/v2.1/os-snapshots/c0e5d456-c4c9-405b-bed0-a9910be896d7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:48:04.390983 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dea3a96e-af94-4977-84f4-6bf149cdf1a7 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Action: 'create', calling method: .version_select at 0x7f0179a6e940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803850990", "metadata": {"Type": "work"}}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dea3a96e-af94-4977-84f4-6bf149cdf1a7 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 120 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:04.396931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1803850990", "metadata": {"Type": "work"}}} Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:04.398199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1803850990', 'metadata': {'Type': 'work'}}}} Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi '0' Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:04.399020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:48:04.400273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:48:04.402198 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 12 18:48:04.402198 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.404763 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dea3a96e-af94-4977-84f4-6bf149cdf1a7 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:04.406007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dea3a96e-af94-4977-84f4-6bf149cdf1a7 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020690 Jul 12 18:48:04.406783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 19/31] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Jul 12 18:48:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:48:04.415228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2b7709d9-df95-41f5-b503-ce391f149179 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:04.419999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2b7709d9-df95-41f5-b503-ce391f149179 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:04.614637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2b7709d9-df95-41f5-b503-ce391f149179 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:04.651492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2b7709d9-df95-41f5-b503-ce391f149179 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1215 microversion: 2.1 time: 0.241379 Jul 12 18:48:04.653521 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 20/32] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:04 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:04.665524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5a7923c0-6e50-4c6d-97fd-3cc27c94fb51 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f01799e73a0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:04.804602 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-561c3f82-f336-40d4-9250-1a0757d50e8d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: .version_select at 0x7f017913ce50>, body: {"keypair": {"name": "tempest-keypair-629255310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7gwdAF8hrBgCfopYC+/Zk2yMEajWut6gzQBhlAxv1qL8ya78X4a2L1frwfpvEdfiKI/PiIj4MXkg9RM5QdYEMk0baBQDLoQpAWyr5xE9iuIXfbN4cl6EZwgY/0mdOrZA=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:04.879749 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-561c3f82-f336-40d4-9250-1a0757d50e8d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:48:04.895488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-561c3f82-f336-40d4-9250-1a0757d50e8d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for user 08ded0d15f774b2f8a63f9bcbe0f8743 and project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:48:04.936342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5a7923c0-6e50-4c6d-97fd-3cc27c94fb51 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 202 len: 0 microversion: 2.1 time: 0.281349 Jul 12 18:48:04.937244 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 21/33] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:48:04 2022] DELETE /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:48:04.945477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-83684cab-5c1d-419a-90a7-f191675cccf9 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Action: 'create', calling method: .version_select at 0x7f017997d4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2093059785", "metadata": {"Type": "work"}}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-83684cab-5c1d-419a-90a7-f191675cccf9 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 119 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:04.951888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2093059785", "metadata": {"Type": "work"}}} Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:04.953931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2093059785', 'metadata': {'Type': 'work'}}}} Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise error Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi '' Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:04.955059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 12 18:48:04.956576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 12 18:48:04.958439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 12 18:48:04.958439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:04.958439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-83684cab-5c1d-419a-90a7-f191675cccf9 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:04.958439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-83684cab-5c1d-419a-90a7-f191675cccf9 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011139 Jul 12 18:48:04.958439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 22/34] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Jul 12 18:48:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:48:04.963825 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8712bf91-f2e3-4422-a93d-c8d21afd2b40 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f01799e73a0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:05.063101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8712bf91-f2e3-4422-a93d-c8d21afd2b40 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 200 len: 345 microversion: 2.1 time: 0.111457 Jul 12 18:48:05.064019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 23/35] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:48:04 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:05.069777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3551e05d-274e-4c53-85c2-e87e851a51e2 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Calling method '.version_select at 0x7f017997dee0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:05.115155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-561c3f82-f336-40d4-9250-1a0757d50e8d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.323485 Jul 12 18:48:05.116822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 13/36] 10.222.0.59 () {62 vars in 1199 bytes} [Tue Jul 12 18:48:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1331 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 12 18:48:05.127043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-3551e05d-274e-4c53-85c2-e87e851a51e2 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] HTTP exception thrown: Volume tempest-invalid-1844537583 could not be found. Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3551e05d-274e-4c53-85c2-e87e851a51e2 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1844537583 HTTP/1.1 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:05.141352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Volume tempest-invalid-1844537583 could not be found. Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'tempest-invalid-1844537583'} Jul 12 18:48:05.142716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1844537583 could not be found. (HTTP 404) (Request-ID: req-83431d20-84aa-4457-acbe-4acc7f9649c5) Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.144041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:05.145217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1844537583 could not be found. Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:05.146317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1844537583 could not be found. Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1844537583 could not be found. Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3551e05d-274e-4c53-85c2-e87e851a51e2 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 404 to user: Volume tempest-invalid-1844537583 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:05.148157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3551e05d-274e-4c53-85c2-e87e851a51e2 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1844537583" status: 404 len: 99 microversion: 2.1 time: 0.078947 Jul 12 18:48:05.155516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 24/37] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Jul 12 18:48:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1844537583 => generated 99 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:48:05.161999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4808281c-84f5-439f-aaec-c678e9b60f88 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004769 Jul 12 18:48:05.163870 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 14/38] 10.222.0.59 () {58 vars in 1139 bytes} [Tue Jul 12 18:48:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 12 18:48:05.176636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-77a11223-6b87-4d24-b6c6-eb7b03bb5c70 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006740 Jul 12 18:48:05.178082 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 25/39] 10.222.0.59 () {58 vars in 1136 bytes} [Tue Jul 12 18:48:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 12 18:48:05.187722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-79ef55f2-291c-4336-af37-94fe384698f1 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Calling method '.version_select at 0x7f0179145310>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:05.232603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-79ef55f2-291c-4336-af37-94fe384698f1 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] HTTP exception thrown: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-79ef55f2-291c-4336-af37-94fe384698f1 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/os-volumes/66ad6163-d17b-4457-b1c7-e7f95e3e50e0 HTTP/1.1 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:48:05.247038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '66ad6163-d17b-4457-b1c7-e7f95e3e50e0'} Jul 12 18:48:05.248462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. (HTTP 404) (Request-ID: req-2176da2d-7aa4-42d5-be90-876492605029) Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.249175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:05.250367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:48:05.251662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-79ef55f2-291c-4336-af37-94fe384698f1 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 404 to user: Volume 66ad6163-d17b-4457-b1c7-e7f95e3e50e0 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:05.252664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-79ef55f2-291c-4336-af37-94fe384698f1 tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/66ad6163-d17b-4457-b1c7-e7f95e3e50e0" status: 404 len: 109 microversion: 2.1 time: 0.068102 Jul 12 18:48:05.253331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 15/40] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:48:05 2022] DELETE /compute/v2.1/os-volumes/66ad6163-d17b-4457-b1c7-e7f95e3e50e0 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:48:05.265040 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-887f049b-2c5a-4e89-a30d-df545ac4f0ca tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Calling method '.version_select at 0x7f01799944c0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:05.325824 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-887f049b-2c5a-4e89-a30d-df545ac4f0ca tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] HTTP exception thrown: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-887f049b-2c5a-4e89-a30d-df545ac4f0ca tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Request method failure captured: Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/os-volumes/818d81bc-7109-4052-b93d-ca343ea01a1b HTTP/1.1 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjyKoZ945IYJDQW9Ywf9Muw89kHG8TUgcxFpnrufR_Krd2NzEJFnHXVnYtgbZLjSloFbjfIpdwkuViTKZZV80UvgjRfIFGzJ-3T4hLIxGeW28emGtBuspRw-UEK5b8uzZH0ERKt6dnIlRHH6CB7HjDYAhBlhnOoPtNUZVn0riM-S4 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:05.328136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_6681a1c90cfe429891671c7549961257", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/6681a1c90cfe429891671c7549961257"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/6681a1c90cfe429891671c7549961257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 6681a1c90cfe429891671c7549961257 Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesNegativeTest-919838214 Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 2cc6265cb2f04916bd8cd4cf358f93b3 Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesNegativeTest-919838214-project Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '818d81bc-7109-4052-b93d-ca343ea01a1b'} Jul 12 18:48:05.329515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. (HTTP 404) (Request-ID: req-da0e7d35-8452-46d9-ab84-3ef16b22afff) Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.330400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:05.337038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:48:05.338278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-887f049b-2c5a-4e89-a30d-df545ac4f0ca tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] Returning 404 to user: Volume 818d81bc-7109-4052-b93d-ca343ea01a1b could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:05.339629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-887f049b-2c5a-4e89-a30d-df545ac4f0ca tempest-VolumesNegativeTest-919838214 tempest-VolumesNegativeTest-919838214-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/818d81bc-7109-4052-b93d-ca343ea01a1b" status: 404 len: 109 microversion: 2.1 time: 0.078341 Jul 12 18:48:05.342095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 26/41] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:48:05 2022] GET /compute/v2.1/os-volumes/818d81bc-7109-4052-b93d-ca343ea01a1b => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:48:05.670931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:05.672099 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:05.685587 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:05.686080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:05.689703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:05.692662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:06.085338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5ad4c272-5173-43f5-bb97-286780b0c4f1 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f017997daf0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:06.146284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-5ad4c272-5173-43f5-bb97-286780b0c4f1 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] HTTP exception thrown: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5ad4c272-5173-43f5-bb97-286780b0c4f1 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Request method failure captured: Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 HTTP/1.1 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHT5NYE5apQO3Z-HpowSMtCfHtBCNx6O3nbfNsxuqdBKxuYwW_qEXIgbpYs_-UtclpqbCMH9yqU9ho7CbDv4C0wruETcD1e6XjUGXjxrLukJ3IHmCuVpk-ZEdh_Yz4r-GDar0wiuEg54f9VQJyjWnqJyMyqvFWiPoA0EuSvM3UYUHY Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:06.148410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_215e56b9a1ff4aa5bd871e16945acae8", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: ad040b4a44244dec892176bb62b57023 Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'e3bbe078-2bd2-460f-8728-5e7861e9cf02'} Jul 12 18:48:06.149647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. (HTTP 404) (Request-ID: req-9f1df75a-638a-4835-ba7e-c52c07345301) Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.150461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:06.151711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:48:06.152807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5ad4c272-5173-43f5-bb97-286780b0c4f1 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Returning 404 to user: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5ad4c272-5173-43f5-bb97-286780b0c4f1 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 404 len: 109 microversion: 2.1 time: 0.071050 Jul 12 18:48:06.153718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 27/42] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:48:06 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:48:06.165943 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-14f39c84-bbfc-4c49-856d-e27025a3d0e6 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f01799e7ee0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:06.182601 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:06.217635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e9417abc-9e9d-4186-9328-f960b6473366 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1219 microversion: 2.1 time: 0.551302 Jul 12 18:48:06.218965 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 16/43] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:05 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1219 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-14f39c84-bbfc-4c49-856d-e27025a3d0e6 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] HTTP exception thrown: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-14f39c84-bbfc-4c49-856d-e27025a3d0e6 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Request method failure captured: Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 HTTP/1.1 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHT5NYE5apQO3Z-HpowSMtCfHtBCNx6O3nbfNsxuqdBKxuYwW_qEXIgbpYs_-UtclpqbCMH9yqU9ho7CbDv4C0wruETcD1e6XjUGXjxrLukJ3IHmCuVpk-ZEdh_Yz4r-GDar0wiuEg54f9VQJyjWnqJyMyqvFWiPoA0EuSvM3UYUHY Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:48:06.234569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_215e56b9a1ff4aa5bd871e16945acae8", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: ad040b4a44244dec892176bb62b57023 Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'e3bbe078-2bd2-460f-8728-5e7861e9cf02'} Jul 12 18:48:06.236028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. (HTTP 404) (Request-ID: req-f1d7d83b-e78a-421c-a0b7-9293ab6de524) Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.236830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 12 18:48:06.238113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 12 18:48:06.239358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-14f39c84-bbfc-4c49-856d-e27025a3d0e6 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Returning 404 to user: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-14f39c84-bbfc-4c49-856d-e27025a3d0e6 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 404 len: 109 microversion: 2.1 time: 0.073926 Jul 12 18:48:06.241475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 28/44] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:48:06 2022] DELETE /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:48:06.250060 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3e8eaf2b-de83-49b8-9313-956a782ea058 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Calling method '.version_select at 0x7f01788ea700>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-3e8eaf2b-de83-49b8-9313-956a782ea058 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] HTTP exception thrown: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3e8eaf2b-de83-49b8-9313-956a782ea058 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Request method failure captured: Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 HTTP/1.1 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHT5NYE5apQO3Z-HpowSMtCfHtBCNx6O3nbfNsxuqdBKxuYwW_qEXIgbpYs_-UtclpqbCMH9yqU9ho7CbDv4C0wruETcD1e6XjUGXjxrLukJ3IHmCuVpk-ZEdh_Yz4r-GDar0wiuEg54f9VQJyjWnqJyMyqvFWiPoA0EuSvM3UYUHY Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:48:06.327566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_215e56b9a1ff4aa5bd871e16945acae8", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/215e56b9a1ff4aa5bd871e16945acae8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 215e56b9a1ff4aa5bd871e16945acae8 Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-422435822 Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: ad040b4a44244dec892176bb62b57023 Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesSnapshotsTestJSON-422435822-project Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'e3bbe078-2bd2-460f-8728-5e7861e9cf02'} Jul 12 18:48:06.329427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. (HTTP 404) (Request-ID: req-e670ec98-7f7e-468d-a0f5-1354cf66e41f) Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.330209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 12 18:48:06.331230 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 12 18:48:06.333224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3e8eaf2b-de83-49b8-9313-956a782ea058 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] Returning 404 to user: Volume e3bbe078-2bd2-460f-8728-5e7861e9cf02 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:48:06.335631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3e8eaf2b-de83-49b8-9313-956a782ea058 tempest-VolumesSnapshotsTestJSON-422435822 tempest-VolumesSnapshotsTestJSON-422435822-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02" status: 404 len: 109 microversion: 2.1 time: 0.082925 Jul 12 18:48:06.340200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 17/45] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:48:06 2022] GET /compute/v2.1/os-volumes/e3bbe078-2bd2-460f-8728-5e7861e9cf02 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:48:07.236923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:07.241226 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:07.255742 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:07.256157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:07.261425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:07.262410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:07.448718 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2027894400", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73f2462e-063e-48c5-a19d-1d4dfbc64d32"}], "security_groups": [{"name": "tempest-securitygroup--1899893765"}], "key_name": "tempest-keypair-82221613", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:07.471799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:07.510696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2973ae53-8395-4e81-8bd2-1c6787c25e7e tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1275 microversion: 2.1 time: 0.275501 Jul 12 18:48:07.522637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 29/46] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:07 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:08.005915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] validate_networks() for [('73f2462e-063e-48c5-a19d-1d4dfbc64d32', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:48:08.528803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:08.530975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:08.544446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:08.544909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:08.549050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:08.549596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:08.697094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:08.724102 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a756271f-68bf-4398-85d3-c285d78cf5fe tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1273 microversion: 2.1 time: 0.200041 Jul 12 18:48:08.726585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 30/47] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:08 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1273 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:09.679184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:48:09.679760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:48:09.680220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:48:09.680635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:48:09.681059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:48:09.697244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:09.697707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:09.704511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:09.704511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:09.743781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:09.745436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:09.748794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for project 2b14300d453444a582d224fcee029d2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:48:09.760534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:09.761258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for user 26993e3a077449da9c71fa7f1023a1e7 and project 2b14300d453444a582d224fcee029d2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:48:09.765511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:09.769032 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:09.769672 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:09.804800 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:48:09.808318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:48:10.056122 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6cc43b98-273d-46f0-a6cd-201d59cf9b41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.612485 Jul 12 18:48:10.075518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 18/48] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:48:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:48:10.095511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c30e2a22-f667-417d-a688-eec00aeb5a5b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:10.095511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c30e2a22-f667-417d-a688-eec00aeb5a5b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:10.404682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c30e2a22-f667-417d-a688-eec00aeb5a5b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:10.425812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c30e2a22-f667-417d-a688-eec00aeb5a5b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1236 microversion: 2.1 time: 0.347173 Jul 12 18:48:10.435429 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 19/49] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:10 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1236 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:10.539925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:10.549685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ec916a2b-8add-410b-8620-0b1b52d230e5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.811347 Jul 12 18:48:10.564496 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 31/50] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:09 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:11.453937 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2a60dcbe-1d9f-4ab1-aac3-0acf4b8e27da tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:11.455340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2a60dcbe-1d9f-4ab1-aac3-0acf4b8e27da tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:11.573047 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2a60dcbe-1d9f-4ab1-aac3-0acf4b8e27da tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:11.579130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:11.580400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:11.593376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2a60dcbe-1d9f-4ab1-aac3-0acf4b8e27da tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1236 microversion: 2.1 time: 0.140666 Jul 12 18:48:11.596185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 20/51] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:11 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1236 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:11.609404 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:11.609863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:11.611042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:11.611518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:12.037133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:12.057299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b052081f-fbdd-4974-a19a-19101c290e49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.490457 Jul 12 18:48:12.058567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 32/52] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:11 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:12.116865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1292233294", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e09cbd83-6a94-4cfd-aea1-1ab194bc236c"}], "security_groups": [{"name": "tempest-securitygroup--987164693"}], "key_name": "tempest-keypair-629255310", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:12.288328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] validate_networks() for [('e09cbd83-6a94-4cfd-aea1-1ab194bc236c', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:48:12.619835 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:12.622733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:12.635918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:12.641870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:12.652165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:12.653475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:12.951753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:12.996585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-95290039-42ec-4e68-8177-86c8ecda8afd tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1240 microversion: 2.1 time: 0.383665 Jul 12 18:48:12.997990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 33/53] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:12 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1240 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:13.076820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:13.077446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:13.105952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:13.106747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:13.109549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:13.109981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:13.479970 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:13.488513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-02a6ba67-9afa-4f4a-9de1-6c61d4806b32 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.414958 Jul 12 18:48:13.499472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 34/54] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:13 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:13.558210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:48:13.559259 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:48:13.559916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:48:13.560555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:48:13.561149 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:48:13.572379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:13.572836 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:13.573645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:13.574088 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:13.609504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:48:13.614239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for user 08ded0d15f774b2f8a63f9bcbe0f8743 and project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:48:13.642385 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:48:13.652257 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:48:13.888114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1eff4cea-950f-4aa5-97bd-1c941367fc67 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.776930 Jul 12 18:48:13.889972 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 21/55] 10.222.0.59 () {62 vars in 1187 bytes} [Tue Jul 12 18:48:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 12 18:48:13.901455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:13.906009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:14.014279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:14.014878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:14.027661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:14.032332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:14.032332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:14.032332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:14.039863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:14.057738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:14.069402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:14.070426 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-52a43937-f703-4def-848a-79feb6444e37 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1281 microversion: 2.20 time: 0.174548 Jul 12 18:48:14.070990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 35/56] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:13 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1281 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:14.136183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:14.165254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a9f84311-5a97-44dc-8079-43ad7c5a362d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1288 microversion: 2.1 time: 0.148661 Jul 12 18:48:14.165254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 22/57] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:14 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1288 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:14.513469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:14.514208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:14.532805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:14.532805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:14.539701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:14.540655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:14.963482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-ff07bdb3-8a70-4bd9-9659-1bcd3a4c2a60 req-9a7cd72f-03cd-48d1-9cf1-37a4e2195465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f154772-6468-47ec-b129-a4ff742f313c", "tag": "3996c8e9-ae7a-40e0-871a-ea93d7a9bce6"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:15.002389 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-ff07bdb3-8a70-4bd9-9659-1bcd3a4c2a60 req-9a7cd72f-03cd-48d1-9cf1-37a4e2195465 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:15.002389 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-ff07bdb3-8a70-4bd9-9659-1bcd3a4c2a60 req-9a7cd72f-03cd-48d1-9cf1-37a4e2195465 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:15.102420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-ff07bdb3-8a70-4bd9-9659-1bcd3a4c2a60 req-9a7cd72f-03cd-48d1-9cf1-37a4e2195465 service nova] Creating event network-changed:3996c8e9-ae7a-40e0-871a-ea93d7a9bce6 for instance 0f154772-6468-47ec-b129-a4ff742f313c on hv-cinder-83538 Jul 12 18:48:15.103095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-ff07bdb3-8a70-4bd9-9659-1bcd3a4c2a60 req-9a7cd72f-03cd-48d1-9cf1-37a4e2195465 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 18:48:15.105902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:15.106377 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:15.107923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:15.108366 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:15.109447 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:15.127932 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ab2a91fe-8119-46eb-9b48-f6e46f01efdc tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.625242 Jul 12 18:48:15.130478 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 36/58] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:14 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:15.139907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:15.149309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:15.149514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.compute.rpcapi [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 18:48:15.155116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] Releasing lock "compute-rpcapi-router" {{(pid=124970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 18:48:15.241519 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e91923c3-57c3-463f-9aea-c19cb490e4cf None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.735693 Jul 12 18:48:15.242371 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 23/59] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:48:15.256146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:15.257244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:15.280234 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:15.280897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:15.284406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:15.285062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:15.336754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:15.351968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:15.354174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:15.358712 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6e515bc0-b1df-4837-96fc-63fb0f785df5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1281 microversion: 2.20 time: 0.224601 Jul 12 18:48:15.363407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 37/60] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:15 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:15.653573 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:15.664089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6835b537-04f4-439d-99bd-2b9713a5ecf8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1294 microversion: 2.1 time: 0.419738 Jul 12 18:48:15.665332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 24/61] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:15 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1294 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:16.145614 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:16.147219 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:16.157278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.159244 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:16.165424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.165424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:16.382437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:16.383229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:16.401816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.402304 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:16.406970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.408040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:16.725374 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:16.741110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:16.744633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:16.746314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9e37e3f0-b415-4606-8422-238601c7bafb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1277 microversion: 2.20 time: 0.368178 Jul 12 18:48:16.748046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 25/62] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:16 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1277 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:16.761461 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:16.768755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:16.773132 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.774507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:16.776851 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:16.777940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:17.073968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:17.111663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cd159c35-e6f8-4834-9c38-7a56d98205c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1294 microversion: 2.1 time: 0.350502 Jul 12 18:48:17.126380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 26/63] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:16 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1294 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:17.131416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:17.140934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4986bc90-8721-4667-bd2a-3a36eafd6754 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.999341 Jul 12 18:48:17.142133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 38/64] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:16 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:17.766810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:17.768485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:17.778506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:17.783640 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:17.786592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:17.788290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:17.949692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:17.960724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:17.970796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:17.972236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-729755ab-605f-4d6e-bf16-37f60023d556 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1333 microversion: 2.20 time: 0.210897 Jul 12 18:48:17.972837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 27/65] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:17 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:48:18.131153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:18.132553 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:18.142073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:18.144769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:18.147147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:18.148098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:18.158610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:18.159549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:18.179279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:18.179279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:18.179279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:18.179279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:18.489919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:18.492858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:18.500609 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e035feab-6f17-4faf-8b4c-9c2d896134a3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.345973 Jul 12 18:48:18.501202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 28/66] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:18 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:18.507231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c4b860d6-ce67-4fc6-88d7-6755f46fd4b5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.374717 Jul 12 18:48:18.508330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 39/67] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:18 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:18.993663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:18.993663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:18.994252 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:18.999233 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:18.999859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.000504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:19.001104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.063834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:19.072212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:19.073734 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:19.074822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b4c46d66-95a5-4b31-9c72-ae7b3dff7c0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1333 microversion: 2.20 time: 0.088078 Jul 12 18:48:19.075448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 29/68] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:18 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:19.517516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:19.518132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:19.525869 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:19.526317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.526814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:19.527079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:19.527543 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.527658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:19.534406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:19.534940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.537030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:19.537911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:19.729743 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:19.738539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c24bd2bf-24e1-4439-ae49-6ffcce59ecf3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.224777 Jul 12 18:48:19.740160 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:19.750154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 40/69] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:19 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:19.754613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ce55dec1-127e-4e19-b5ca-88c9e6d6d333 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.232516 Jul 12 18:48:19.755550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 30/70] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:19 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:20.093176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:20.093834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:20.100557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.101007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.101791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.102257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.171885 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:20.181130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:20.182643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:20.187524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4c072a21-06ce-48ef-9332-b9e3695692e7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1333 microversion: 2.20 time: 0.094748 Jul 12 18:48:20.187524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 41/71] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:20 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:20.758202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:20.758818 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:20.764894 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.765352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.766119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.766553 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.776313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:20.777299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:20.783388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.783838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.784631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:20.785067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:20.979601 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:20.991774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:20.996780 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-beac3061-7dc0-48ae-b1e1-166fa1c8d829 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.244001 Jul 12 18:48:20.997367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 31/72] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:20 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:21.002166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-22174a1e-c203-460b-a909-c03f49d0f113 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.229667 Jul 12 18:48:21.002872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 42/73] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:20 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:21.204616 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:21.205249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:21.211361 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:21.211842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:21.212606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:21.213045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:21.275295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:21.283325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:21.284882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:21.286046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0f7d2830-0c29-4e24-b580-8f17d0577fc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1333 microversion: 2.20 time: 0.085721 Jul 12 18:48:21.287540 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 32/74] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:21 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:22.017740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:22.019407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:22.021434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:22.022486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:22.028086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.028778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.030175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.030778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.038576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.038576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.038576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.039055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.369280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:22.377476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2cdcb5b8-fbce-4286-b7e2-3c60a87f6120 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.361810 Jul 12 18:48:22.385538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:22.388064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 33/75] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:22 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:22.399086 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:22.399763 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:22.404441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c9290f5b-a2de-484c-9621-c24b291928db tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.392113 Jul 12 18:48:22.405444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 43/76] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:22 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:22.409303 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.409982 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.410938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:22.411650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:22.498496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:22.513549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:22.516095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:22.517501 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-13a1c48b-bf60-430c-b8ee-438ce362eb89 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1341 microversion: 2.20 time: 0.123029 Jul 12 18:48:22.532177 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 34/77] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:22 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1341 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:23.395957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:23.396863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:23.407000 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.407483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.410800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.410800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.422606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:23.423934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:23.436482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.436482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.436482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.436482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.636679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=30 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:23.646656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:23.650258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:23.655089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cfbfea86-3469-4639-8197-c434783e27c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.236689 Jul 12 18:48:23.659432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 35/78] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:23 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:23.663853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:23.664536 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:23.667740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3baf4099-7b03-4abd-8907-d3f665b6c7be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.271938 Jul 12 18:48:23.668440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 44/79] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:23 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:23.672173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.672957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.674024 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:23.674666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:23.783699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:23.790172 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:23.803229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:23.805428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:23.806845 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9b0aea73-5a80-416e-98e8-f93801d42d99 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1341 microversion: 2.20 time: 0.150177 Jul 12 18:48:23.817736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 36/80] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:23 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:24.676201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:24.676201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:24.681971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.682370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.683342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.683751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.688291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:24.688920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:24.696399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.696889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.698029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.698636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.904571 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:24.908495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:24.913122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cfb419ce-be42-4e33-9d85-ac633ef3cea2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.243196 Jul 12 18:48:24.913705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 45/81] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:24 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:24.916555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-27daeec7-527e-40b0-ba41-cf5fff15d4fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.234440 Jul 12 18:48:24.917109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 37/82] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:24 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:24.918270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:24.918878 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:24.928611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.928993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.929782 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:24.930220 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:24.997632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:25.006104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:25.011893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:25.011893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3929365e-0679-46fb-be9d-cf837a012659 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1341 microversion: 2.20 time: 0.094434 Jul 12 18:48:25.011893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 46/83] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:24 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1341 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:25.934780 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:25.937507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:25.938815 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:25.939759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:25.945415 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=8 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:25.948046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=10 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:25.952317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:25.956040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:25.957005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:25.958745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:25.960008 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:25.964151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:25.965411 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:25.966521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:25.980479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:26.249031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:26.252311 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:26.260041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8f4bcbb1-1254-4f9d-b07b-0f3605682828 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.329786 Jul 12 18:48:26.263818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 47/84] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:25 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:26.263929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4d8ce8a4-c275-40b9-9b3b-a7179776d1d9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.334928 Jul 12 18:48:26.265949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:26.266783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:26.270820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 38/85] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:25 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:26.274484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:26.275010 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:26.275910 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:26.276401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:26.356697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:26.367516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:26.369149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:26.370383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e4ac92bf-e652-4a15-ba92-c88648e95722 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1351 microversion: 2.20 time: 0.108552 Jul 12 18:48:26.371630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 48/86] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:26 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:27.278405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:27.279178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:27.281480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:27.282945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:27.287802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.297694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.298610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.299011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.299987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.300680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.305758 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.307625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.689741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:27.704397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d1dcb801-25b9-4b60-ad77-0eac279c719d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.426002 Jul 12 18:48:27.704515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:27.704629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 49/87] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:27 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:27.709555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:27.710169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:27.715504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-689bdc5f-12b9-4afc-8127-8c0613237e9c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.441416 Jul 12 18:48:27.716091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 39/88] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:27 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:27.717190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.717805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.718767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.719393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.789617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-4393bc6e-9e6f-409d-9de5-ad940ccf02b7 req-09ae95fd-7b18-4b9f-ae05-0259cfa6a5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79956b08-375e-45c0-8616-a59bdbe15dea", "tag": "be33f777-fc8d-432e-ab16-15bec479526a"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:27.801110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-4393bc6e-9e6f-409d-9de5-ad940ccf02b7 req-09ae95fd-7b18-4b9f-ae05-0259cfa6a5cd service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:27.801110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-4393bc6e-9e6f-409d-9de5-ad940ccf02b7 req-09ae95fd-7b18-4b9f-ae05-0259cfa6a5cd service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:27.810669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-4393bc6e-9e6f-409d-9de5-ad940ccf02b7 req-09ae95fd-7b18-4b9f-ae05-0259cfa6a5cd service nova] Creating event network-changed:be33f777-fc8d-432e-ab16-15bec479526a for instance 79956b08-375e-45c0-8616-a59bdbe15dea on hv-cinder-83538 Jul 12 18:48:27.815753 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-4393bc6e-9e6f-409d-9de5-ad940ccf02b7 req-09ae95fd-7b18-4b9f-ae05-0259cfa6a5cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098374 Jul 12 18:48:27.816354 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 40/89] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:27.860940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:27.879800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:27.879800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:27.879800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c6319eae-45da-4e1a-89eb-a3955a3cdcf0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.169574 Jul 12 18:48:27.880650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 50/90] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:27 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:28.721362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:28.722083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:28.728611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.729057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:28.729815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.730244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:28.736607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:28.737258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:28.739166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:28.744352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.744787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:28.745728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.746423 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:28.937175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:28.945857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b5f5dd17-8258-4cd2-81d4-f983f55dcac8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.228719 Jul 12 18:48:28.946443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 41/91] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:28 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:28.950176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:28.951465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:28.952463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:28.957955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-aa57a785-a1fb-4a76-837c-626c9268ad42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.225177 Jul 12 18:48:28.959166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.959288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 51/92] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:28 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:28.959706 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:28.960490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:28.960930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:29.093002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:29.101514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:29.102968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:29.104127 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-04223357-fe08-4527-917e-2b1df1c3dd9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.156759 Jul 12 18:48:29.104693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 42/93] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:28 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:29.962565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:29.963166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:29.969187 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:29.969617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:29.970371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:29.971053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:29.976044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:29.976661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:29.982562 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:29.983014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:29.983900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:29.984338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:30.174631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:30.181965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0a12e61c-c336-4d4e-971d-f3c58236f711 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.223933 Jul 12 18:48:30.182534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 52/94] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:29 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:30.185721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:30.187349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:30.187939 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:30.193953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cc1ad58a-47ea-46a4-b5e7-bc3161016ea3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.222256 Jul 12 18:48:30.194797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 43/95] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:29 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:30.195178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:30.195650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:30.196412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:30.196840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:30.327254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:30.336510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:30.338022 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:30.339123 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-46a8bcbd-d587-427f-abda-e9638ddc6e72 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.155297 Jul 12 18:48:30.339718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 53/96] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:30 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:31.198001 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:31.198619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:31.204765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.205235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.206000 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.206438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.210446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:31.211060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:31.217111 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.217502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.218323 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.218755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.404776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:31.408787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:31.413652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-288e3e98-533b-406e-a191-add0ba6141d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.219381 Jul 12 18:48:31.414239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 44/97] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:31 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:31.417168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-83d3b976-f0ad-4447-af0a-49f3d9580a3e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.210986 Jul 12 18:48:31.417869 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 54/98] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:31 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:31.418795 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:31.419345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:31.425256 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.425707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.426464 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:31.426936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:31.558193 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:31.566144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:31.572990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:31.572990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-94ce5c44-99f0-4ca7-b825-75ddc6d828d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.153647 Jul 12 18:48:31.572990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 45/99] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:31 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:32.430881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:32.431647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:32.433787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:32.434486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:32.438509 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.438951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.439792 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.440274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.447270 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.447803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.448652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.449042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.675063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:32.680907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:32.684044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a20c3262-3e8e-41cd-a5b2-ae880bfb3529 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.257439 Jul 12 18:48:32.684830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 55/100] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:32 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:32.688508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5a7a3096-73fc-4b21-9211-7e1f06f30b8b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.258731 Jul 12 18:48:32.689346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:32.689947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:32.699860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 46/101] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:32 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:32.700091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.700091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.700091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:32.728136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:32.844518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:32.854411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:32.855960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:32.857063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-565135d7-c0a9-4b72-a128-e0612efc369f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.171279 Jul 12 18:48:32.857622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 56/102] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:32 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:33.702042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:33.702783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:33.708665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.709112 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:33.710007 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.710435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:33.713564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:33.714166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:33.720140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.720586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:33.721346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.721788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:33.910657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:33.915521 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:33.918951 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cd90ea9d-b32a-47ce-afba-e237104cbf1f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.220836 Jul 12 18:48:33.919725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 47/103] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:33 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:33.924073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-27640d77-26af-43e8-a22c-3ea51b02ce74 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.214243 Jul 12 18:48:33.925651 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:33.926954 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:33.929333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 57/104] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:33 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:33.938297 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.939013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:33.940158 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:33.940789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:34.075326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:34.083216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:34.084731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:34.085828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-25fa0fc6-fd89-47c9-bdfc-dc2c45a62406 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.164867 Jul 12 18:48:34.086382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 48/105] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:33 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:34.935603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:34.936216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:34.941686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:34.942438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:34.942701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:34.943173 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:34.944608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:34.945067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:34.949628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:34.950183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:34.951057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:34.951596 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:35.142229 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:35.146089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:35.149803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-73f66925-2406-4a64-97eb-2b1bfc7d23d0 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.218045 Jul 12 18:48:35.150381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 58/106] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:34 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:35.154125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6f534291-1682-44da-a3b5-cd630eecd83e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.216183 Jul 12 18:48:35.154801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 49/107] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:34 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:35.154919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:35.155427 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:35.161461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:35.162100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:35.163152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:35.163676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:35.292968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:35.300835 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:35.302339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:35.304015 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-52660452-7061-4c92-87f6-8fa47d2c6d6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.152708 Jul 12 18:48:35.304600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 59/108] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:35 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:36.167062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:36.167794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:36.170569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:36.171171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:36.174725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.175654 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.175986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.176425 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.177305 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.177764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.178579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.179008 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.365793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:36.373960 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2f3ab0d3-9ba0-4cce-b659-79f724736b49 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.211715 Jul 12 18:48:36.374865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 50/109] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:36 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:36.379490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:36.380098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:36.385179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:36.387647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.393387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.393387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:36.393387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:36.393676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9d97669a-d69f-4eda-9fa0-54abfb69644b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.226516 Jul 12 18:48:36.394090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 60/110] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:36 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:36.525066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:36.533346 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:36.534850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:36.535974 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-55928f9a-de80-4af7-8fd9-e352e1de55a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.160162 Jul 12 18:48:36.536527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 51/111] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:36 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:37.393363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:37.394007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:37.400439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.400761 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:37.401530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.401957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:37.412529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:37.413859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:37.420284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.420746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:37.421515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.422189 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:37.661778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:37.673628 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-09b9ab85-d5ed-4448-afa0-1d011882b778 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.284887 Jul 12 18:48:37.674581 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 61/112] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:37 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:37.675655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:37.682231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:37.687342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:37.688406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0f95ea7a-b7e7-4aac-bddc-b97a6dc5c187 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.279635 Jul 12 18:48:37.689349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 52/113] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:37 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:37.696743 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.697616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:37.699474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:37.700069 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:38.227053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:38.236296 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:38.237787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:38.238889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e3563312-b02e-4756-9b67-42756b6b084e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.562971 Jul 12 18:48:38.246920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 62/114] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:37 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:38.692237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:38.692861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:38.699791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:38.700247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:38.701352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:38.701817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:38.709270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:38.711702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:38.718643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:38.719099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:38.719922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:38.725586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.075633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:39.085562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4220232c-c3ad-44ad-a04e-a77c0d782a54 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.382119 Jul 12 18:48:39.086924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 63/115] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:38 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:39.091726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-a906b2bc-e862-4c36-9120-ba192998ea62 req-db973119-caad-4f54-820f-9a6cb425ee7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:39.107475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a906b2bc-e862-4c36-9120-ba192998ea62 req-db973119-caad-4f54-820f-9a6cb425ee7b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:39.107957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a906b2bc-e862-4c36-9120-ba192998ea62 req-db973119-caad-4f54-820f-9a6cb425ee7b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.122222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:39.129731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-a906b2bc-e862-4c36-9120-ba192998ea62 req-db973119-caad-4f54-820f-9a6cb425ee7b service nova] Creating event network-changed:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:48:39.130662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a906b2bc-e862-4c36-9120-ba192998ea62 req-db973119-caad-4f54-820f-9a6cb425ee7b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 12 18:48:39.131935 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:39.132440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.133420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:39.133853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.138558 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:39.150974 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.compute.rpcapi [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 12 18:48:39.150974 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] Releasing lock "compute-rpcapi-router" {{(pid=124971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 12 18:48:39.155928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-960c283b-ce44-4980-82c1-32947717a89d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.461015 Jul 12 18:48:39.156980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 53/116] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:38 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:39.178829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-17edbffc-5836-46a9-920c-4c446415f337 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090391 Jul 12 18:48:39.179750 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 64/117] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:39.260480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:39.263322 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:39.284196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:39.286268 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.288729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:39.289591 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:39.340425 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:39.517488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:39.529575 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:39.531290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:39.532495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-acaa22b6-4995-4dd3-bdad-8663c2d8b997 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.278844 Jul 12 18:48:39.533242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 54/118] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:39 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:40.109852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:40.109852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:40.113051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.113502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.114266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.114702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.174537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:40.175138 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:40.181481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.181854 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.182617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.183166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.301752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:40.314018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d0e2f29b-86bc-404f-aee7-6fd0190ada3f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.211397 Jul 12 18:48:40.315258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 65/119] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:40 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:40.361741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:40.371402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a845b9b2-fb79-48ab-a729-b1747000524d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.201037 Jul 12 18:48:40.372760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 55/120] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:40 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:40.550669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:40.551456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:40.559429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.559882 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.560851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:40.561347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:40.706713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:40.715849 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:40.717379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:40.718500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ac782e25-7a5a-4e70-8555-f40c83a6bdd8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.171680 Jul 12 18:48:40.719076 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 66/121] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:40 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:41.332427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:41.333050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:41.347908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.348512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.349350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.349808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.389215 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:41.389772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:41.396206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.396654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.397652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.398714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.563912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:41.577991 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-02b1aec0-d04d-43d5-b68f-802d082cd279 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.245528 Jul 12 18:48:41.577991 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 56/122] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:41 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:41.599548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:41.608573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d5208ecd-73a9-47ea-ab7e-f3a9d8bb9e83 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.223242 Jul 12 18:48:41.622429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 67/123] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:41 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:41.737538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:41.738392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:41.745287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.745665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.746436 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:41.747151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:41.887801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:41.896381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:41.898814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:41.899937 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b3ecb88e-b68c-4269-abae-33b9b8db9a54 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.166628 Jul 12 18:48:41.900499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 57/124] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:41 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:42.596164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:42.600526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:42.603871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.604308 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:42.605275 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.605853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:42.630056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:42.631403 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:42.641525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.642616 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:42.643806 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.644441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:42.804058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:42.825663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3736d329-5ce5-4cd2-abfb-2980a318732c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.233580 Jul 12 18:48:42.831617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 68/125] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:42 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:42.852468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:42.860959 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ba6f020c-9a5b-4e4c-b50e-2f4d46a86d78 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.238958 Jul 12 18:48:42.861867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 58/126] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:42 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:42.918338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:42.918954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:42.929623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.930570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:42.931491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:42.931895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:43.104544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:43.116941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:43.119684 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:43.121625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-60a9ec4e-280c-441e-b05d-0732814bba0a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.207412 Jul 12 18:48:43.122797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 69/127] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:42 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:43.845065 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:43.848023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:43.855223 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:43.855708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:43.856655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:43.857098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:43.878603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:43.879913 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:43.888232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:43.888673 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:43.889437 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:43.892771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:44.089136 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:44.097639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:44.097740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-efa7439e-a1fe-412d-8253-883b6e85a68e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.256351 Jul 12 18:48:44.106475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 59/128] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:43 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:44.106830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c8f96fa4-7ece-4f05-b587-38453f25e5cd tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.232140 Jul 12 18:48:44.110772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 70/129] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:43 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:44.141696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:44.142315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:44.148468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:44.148912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:44.149732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:44.150162 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:44.459962 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:44.466918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:44.468560 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:44.469761 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e470d7c0-db5b-4283-9113-8f16b176bd4f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.332043 Jul 12 18:48:44.482019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 60/130] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:44 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:45.113984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:45.115959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:45.124686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.125414 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.126508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.127259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.129552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:45.130329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:45.141564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.142454 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.143582 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.146887 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.439827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:45.453043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-53f01d81-d183-46a1-9908-c88fe327895e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.343336 Jul 12 18:48:45.454035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 71/131] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:45 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:45.495513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:45.495513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:45.501854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.502350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.503148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:45.508055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:45.526785 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:45.541707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5a62fd13-3a0b-48db-b067-7d62e1d80f16 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.411663 Jul 12 18:48:45.544897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 61/132] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:45 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:45.693110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:45.702628 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:45.704178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:45.705276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0628254b-47e8-4a3e-af06-e0c044e73088 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.219887 Jul 12 18:48:45.705830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 72/133] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:45 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:48:46.471075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:46.472333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:46.482277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.482796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.483764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.484264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.561132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:46.561744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:46.568368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.569051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.569825 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.570292 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.674577 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:46.684420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-74710b91-437b-4670-8185-4e5ae699b35b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.218168 Jul 12 18:48:46.685251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 62/134] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:46 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:46.724181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:46.724955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:46.732545 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.733077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.737875 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:46.737875 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:46.744636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:46.753448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ad5bcde0-cd4a-4b3c-977c-11e5beee45c7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.196341 Jul 12 18:48:46.754438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 73/135] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:46 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:46.880136 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:46.890019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:46.891820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:46.892939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dade12a1-13f8-46ca-be5c-029eb14331c5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.172970 Jul 12 18:48:46.894181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 63/136] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:46 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:48:47.406778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-bc7eb775-e1c9-4b83-93bd-be27271cbc1f req-ca959579-d71e-486e-9b3c-0f6b74411482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f154772-6468-47ec-b129-a4ff742f313c", "name": "network-vif-plugged", "status": "completed", "tag": "3996c8e9-ae7a-40e0-871a-ea93d7a9bce6"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:47.415566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-bc7eb775-e1c9-4b83-93bd-be27271cbc1f req-ca959579-d71e-486e-9b3c-0f6b74411482 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.416009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-bc7eb775-e1c9-4b83-93bd-be27271cbc1f req-ca959579-d71e-486e-9b3c-0f6b74411482 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.426999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-bc7eb775-e1c9-4b83-93bd-be27271cbc1f req-ca959579-d71e-486e-9b3c-0f6b74411482 service nova] Creating event network-vif-plugged:3996c8e9-ae7a-40e0-871a-ea93d7a9bce6 for instance 0f154772-6468-47ec-b129-a4ff742f313c on hv-cinder-83538 Jul 12 18:48:47.432813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-bc7eb775-e1c9-4b83-93bd-be27271cbc1f req-ca959579-d71e-486e-9b3c-0f6b74411482 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090825 Jul 12 18:48:47.433403 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 74/137] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:48:47.705000 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:47.709580 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:47.714079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.714943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.716005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.716590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.772695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:47.775191 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:47.782131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.782716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.783541 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.784216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.927779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:47.936816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e7b7c631-68f0-42ae-abe3-bde594eeabc1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.236436 Jul 12 18:48:47.937490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 64/138] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:47 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:47.943479 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:47.944379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:47.951824 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.952265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.953030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:47.953452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:47.974181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:47.983935 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cd4f33e0-d762-474f-b0d6-b1281680ad0a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.215854 Jul 12 18:48:47.984543 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 75/139] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:47 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:48.100408 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:48.109857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:48.111473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:48.112848 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-53efd07e-4b50-47a4-8b5f-e70223f79ec3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.173652 Jul 12 18:48:48.114968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 65/140] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:47 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:48.954936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:48.955602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:48.961903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:48.962350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:48.963114 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:48.963572 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:49.003966 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:49.004721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:49.010975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:49.011546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:49.012392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:49.012901 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:49.142626 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:49.165918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:49.173445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a8873957-3076-4ed6-a795-015b9fbddb79 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.222810 Jul 12 18:48:49.174026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 76/141] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:48 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:49.188144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:49.189165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:49.189773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:49.197115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:49.197229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e3c166de-3df5-49f8-bff3-7c11cc238d43 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.196927 Jul 12 18:48:49.197420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:49.198197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:49.202119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:49.203017 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 66/142] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:48 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:49.352411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:49.360564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:49.362074 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:49.363167 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-639979dd-9b63-4b24-ae04-701ea44d2392 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.177876 Jul 12 18:48:49.363764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 77/143] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:49 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:50.190980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:50.191624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:50.193505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=76 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:50.199037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.199513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.200274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.200697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.222899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:50.224131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:50.233063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.233505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.234257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.234679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.485387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:50.490389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:50.509313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8ae1bc33-4377-4a8b-be1b-c95adaebf2a5 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.289728 Jul 12 18:48:50.510461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 78/144] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:50 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:50.513913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-10a5d10c-13c7-470f-8233-6ed24b822c5e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.326555 Jul 12 18:48:50.515100 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 67/145] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:50 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:50.520841 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:50.521971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:50.533682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.534264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.535376 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:50.536388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:50.701998 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:50.710150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:50.712522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:50.713682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-266a4a47-59d7-4865-aa04-e75f740df91e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.201558 Jul 12 18:48:50.714245 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 79/146] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:50 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:51.537338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:51.542740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:51.542740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:51.543280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:51.547349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.547349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.547728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.548335 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.559882 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.560457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.561326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.561754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.783598 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:51.784020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:51.787645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d26fe03e-901a-4039-b32d-0588a7c586ed tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.249324 Jul 12 18:48:51.790151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 68/147] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:51 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:51.791205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5e8d2dbb-eff6-412f-bdb7-cbdf83bf12bb tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.257443 Jul 12 18:48:51.801101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 80/148] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:51 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:51.805511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:51.806364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:51.813314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.813756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.814630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:51.815059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:51.947441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:51.955513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:51.957025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:51.958504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3aaf3303-0cd7-4f10-ac66-e932e351848e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.166838 Jul 12 18:48:51.959073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 69/149] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:51 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:52.807528 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:52.808051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:52.810365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:52.811832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:52.815293 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:52.815772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:52.816698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:52.817297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:52.820574 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:52.821202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:52.823145 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:52.825299 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:53.044328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:53.047900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:53.051271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:53.052080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:53.054331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-53c8ddcd-0af8-42db-b066-dec9e5050cc9 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.249548 Jul 12 18:48:53.055456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 70/150] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:52 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:53.057126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-62ab6824-684f-41c3-85e1-e7bad8baeb7a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.254469 Jul 12 18:48:53.062358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 81/151] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:52 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:53.063380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:53.063995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:53.070414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:53.070859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:53.072244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:53.072681 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:53.143412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-7e087fef-019a-4e22-a3b1-191d359536ff req-6af7cfee-2d5b-435c-b6f3-7dc13989b45f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79956b08-375e-45c0-8616-a59bdbe15dea", "name": "network-vif-plugged", "status": "completed", "tag": "be33f777-fc8d-432e-ab16-15bec479526a"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:48:53.152771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7e087fef-019a-4e22-a3b1-191d359536ff req-6af7cfee-2d5b-435c-b6f3-7dc13989b45f service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:53.153202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7e087fef-019a-4e22-a3b1-191d359536ff req-6af7cfee-2d5b-435c-b6f3-7dc13989b45f service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:53.166180 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-7e087fef-019a-4e22-a3b1-191d359536ff req-6af7cfee-2d5b-435c-b6f3-7dc13989b45f service nova] Creating event network-vif-plugged:be33f777-fc8d-432e-ab16-15bec479526a for instance 79956b08-375e-45c0-8616-a59bdbe15dea on hv-cinder-83538 Jul 12 18:48:53.170730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-7e087fef-019a-4e22-a3b1-191d359536ff req-6af7cfee-2d5b-435c-b6f3-7dc13989b45f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031199 Jul 12 18:48:53.171344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 82/152] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:48:53.214325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:53.222731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:53.225130 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:53.227028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3ce10546-4f02-4bdf-9a2f-b6d61033d4b5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.168853 Jul 12 18:48:53.227028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 71/153] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:53 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:54.082954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:54.084642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:54.087801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:54.088597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:54.094951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.099273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.099273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.099504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.099593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.099676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.099773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.099874 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.432187 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:54.434479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:54.441807 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3da46c54-a583-423b-b41b-94c7345b98ec tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.359639 Jul 12 18:48:54.447457 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 72/154] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:54 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:54.447602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2bbc2b6d-c875-44d6-b68e-d3978d43f48d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.369483 Jul 12 18:48:54.447602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 83/155] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:54 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:54.448450 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:54.449305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:54.457848 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.458290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.459055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:54.459506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:54.597092 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:54.608589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:54.608589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:54.608589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5303215e-f54b-4e72-8f43-ddaf94ffb334 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.164718 Jul 12 18:48:54.608907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 73/156] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:54 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:55.461700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:55.462359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:55.462359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:55.463492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:55.469269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.469482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.469716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.469814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.470489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.470599 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.470926 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.471018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.673067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:55.677211 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:55.681862 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5a06e989-aa0c-400e-bd1a-038a4830a581 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.223656 Jul 12 18:48:55.682694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 84/157] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:55 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:55.687715 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:55.688307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:55.694378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.695089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.695598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:55.696030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:55.696968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-01b97501-d08e-4044-a241-e7911e4e8549 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.238920 Jul 12 18:48:55.699498 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 74/158] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:55 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:55.842302 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:55.854991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:55.856728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:55.857639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-826c33f9-5237-4941-9af5-ced357a5842a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.173729 Jul 12 18:48:55.858178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 85/159] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:55 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:56.699906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:56.700419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:56.706619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.707073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:56.707952 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.708392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:56.719522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:56.720866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:56.727397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.728064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:56.730146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.730580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:56.925699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:56.931050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:56.940978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-09b12c4e-c2de-468e-a3e6-520cbeec5364 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.227113 Jul 12 18:48:56.941559 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 86/160] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:56 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:48:56.943765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9a4cde12-12fa-47ba-af0d-b3c8b31848be tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.247981 Jul 12 18:48:56.946913 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:56.948420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:56.954623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.955648 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:56.955905 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 75/161] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:56 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:56.956811 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:56.957270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:57.097736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:57.106449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:57.107980 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:57.109078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-77c1f610-4885-4d78-bfeb-0753547075ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.166621 Jul 12 18:48:57.109643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 87/162] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:56 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:57.963446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:57.964797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:57.965261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:57.965452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:57.971594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:57.980287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:57.980534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:57.980633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:57.980710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:57.980781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:57.980851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:57.980920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:58.173734 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:58.177289 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:58.181822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-025a256a-3114-45d1-aed8-0f6acb760cd6 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.222742 Jul 12 18:48:58.182570 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 76/163] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:57 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:58.184802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-858a8c2e-5de1-483e-bf3c-c6bb31a3034b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.225764 Jul 12 18:48:58.194132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 88/164] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:57 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:58.194273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:58.194273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:58.194273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:58.194273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:58.195003 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:58.195421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:58.327265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:58.334584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:58.336127 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:58.337214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-084e732d-0696-4614-bb20-d751c1ef19ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.153735 Jul 12 18:48:58.337840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 77/165] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:58 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:48:59.199863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:59.201322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:59.202495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:59.203346 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:59.205058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=76 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:48:59.209031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.209660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.210235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.210652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.210760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.211219 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.211592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.212049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.424115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:59.426759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:59.436445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fbc81f3a-d6e9-40dd-b4c7-0c526c33e502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.238522 Jul 12 18:48:59.444810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b1c20472-30c2-4b72-aa85-8f8641894c81 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.242372 Jul 12 18:48:59.444810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 89/166] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:59 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:59.444810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:48:59.444810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:48:59.445610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 78/167] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:48:59 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:48:59.451027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.451507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.452533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:48:59.452948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:48:59.605598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:59.613844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:59.618291 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:48:59.618291 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c6421596-3fd4-4e27-9a30-c1f3da3e5fb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.177005 Jul 12 18:48:59.618291 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 90/168] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:48:59 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:00.041443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-187ed281-b1dd-4569-a551-f27afdb3afe3 req-2574a721-ebaa-418b-93e7-0a7ee48dad0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "name": "network-vif-plugged", "status": "completed", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:00.050219 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-187ed281-b1dd-4569-a551-f27afdb3afe3 req-2574a721-ebaa-418b-93e7-0a7ee48dad0e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.050663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-187ed281-b1dd-4569-a551-f27afdb3afe3 req-2574a721-ebaa-418b-93e7-0a7ee48dad0e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.062832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-187ed281-b1dd-4569-a551-f27afdb3afe3 req-2574a721-ebaa-418b-93e7-0a7ee48dad0e service nova] Creating event network-vif-plugged:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:49:00.068030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-187ed281-b1dd-4569-a551-f27afdb3afe3 req-2574a721-ebaa-418b-93e7-0a7ee48dad0e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Jul 12 18:49:00.068695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 79/169] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:00.453848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:00.454637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:00.454844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:00.455594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:00.460979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.465483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.465613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.465613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.465773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.465773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.465932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.465932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.682210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:00.696124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a17830a1-94d7-41e8-b44c-ca0cc9b5c5e7 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1315 microversion: 2.1 time: 0.245603 Jul 12 18:49:00.697462 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 91/170] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:00 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:00.702278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:00.704049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:00.704786 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:00.711573 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ffd2f422-e266-4b01-a08d-c1bf11c81fe5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1362 microversion: 2.1 time: 0.261027 Jul 12 18:49:00.713882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 80/171] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:00 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:49:00.718036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.718502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.719491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:00.720252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:00.873969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:00.885100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:00.887122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:00.888345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5effefea-a9ec-49b0-acbf-858bb7438698 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.189105 Jul 12 18:49:00.888984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 92/172] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:00 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:01.712667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:01.713863 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:01.720095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:01.720546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:01.721398 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:01.721835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:01.733232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:01.733864 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:01.741374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:01.741374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:01.741898 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:01.742337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:01.959250 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:01.965275 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:01.974799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-60e6e829-6e1b-4b74-8507-36586283ca92 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1549 microversion: 2.1 time: 0.244545 Jul 12 18:49:01.976519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 93/173] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:01 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1549 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:49:01.989806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:01.991156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:02.002761 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:02.003723 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:02.004699 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:02.005421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:02.019420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dd159679-898e-4dda-a908-52e0d97cfa98 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1501 microversion: 2.1 time: 0.310302 Jul 12 18:49:02.031899 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 81/174] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:01 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1501 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:02.038693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:02.039437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:02.047252 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:02.048055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:02.049878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:02.050783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:02.222673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e10fa12b-a6e1-4460-a5fd-ee631d7714cc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.189604 Jul 12 18:49:02.223667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 82/175] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 18:49:02 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:02.275071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:02.285612 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:02.287283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:02.288956 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1b3fc594-9f33-4d7c-bf21-3f3cec94b0f9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.310420 Jul 12 18:49:02.295851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 94/176] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:01 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:03.309608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:03.310331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:03.319395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:03.320013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:03.321052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:03.321675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:03.493037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:03.502996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:03.505497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:03.508282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cbb0ffa1-5993-4562-9b98-b5d940e89bb8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.203890 Jul 12 18:49:03.508590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 83/177] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:03 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:03.733480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-a0a2356d-3f3b-4c2c-8b19-34914d0ed797 req-a00b8b37-2e6c-49e3-8941-3fcc1797228c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79956b08-375e-45c0-8616-a59bdbe15dea", "tag": "be33f777-fc8d-432e-ab16-15bec479526a"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:03.744997 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a0a2356d-3f3b-4c2c-8b19-34914d0ed797 req-a00b8b37-2e6c-49e3-8941-3fcc1797228c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:03.745552 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a0a2356d-3f3b-4c2c-8b19-34914d0ed797 req-a00b8b37-2e6c-49e3-8941-3fcc1797228c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:03.758630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-a0a2356d-3f3b-4c2c-8b19-34914d0ed797 req-a00b8b37-2e6c-49e3-8941-3fcc1797228c service nova] Creating event network-changed:be33f777-fc8d-432e-ab16-15bec479526a for instance 79956b08-375e-45c0-8616-a59bdbe15dea on hv-cinder-83538 Jul 12 18:49:03.765464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-a0a2356d-3f3b-4c2c-8b19-34914d0ed797 req-a00b8b37-2e6c-49e3-8941-3fcc1797228c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035691 Jul 12 18:49:03.767641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 95/178] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:04.537288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:04.538126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:04.545325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:04.545779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:04.546592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:04.547196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:04.882964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:04.895223 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:04.897598 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:04.899027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-63c33b41-e0bf-42ce-801b-2891a1bd86de tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.365804 Jul 12 18:49:04.899857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 84/179] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:04 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:05.918629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:05.919338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:05.926020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:05.926529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:05.927334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:05.927850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:06.066235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:06.075494 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:06.077020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:06.078128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ee545fa3-17f7-4112-9e45-129bd5dfd728 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.163923 Jul 12 18:49:06.078740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 96/180] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:05 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:07.097254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:07.097904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:07.104500 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:07.105049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:07.105813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:07.106244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:07.240318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:07.248739 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:07.250355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:07.251564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bd78ee6b-b846-4eaf-a880-44c44c844177 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.158220 Jul 12 18:49:07.252265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 85/181] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:07 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:08.270173 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:08.270769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:08.278443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:08.278894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:08.279712 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:08.280152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:08.425416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:08.434562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:08.436489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:08.448129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-70f97631-c9ef-47b6-8e3d-5b219a33502c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1406 microversion: 2.20 time: 0.171423 Jul 12 18:49:08.448129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 97/182] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:08 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:49:09.293558 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a96e247a-db3e-4127-92d1-1eb19bf3de12"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:09.294706 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:09.303551 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.304234 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.305546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.306267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.457686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:09.458600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:09.465891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.466337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.467098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.467553 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.606968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:09.615467 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:09.616990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:09.618204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-393c80c4-4f4f-4ee5-a2d2-298c78704d73 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1598 microversion: 2.20 time: 0.164603 Jul 12 18:49:09.619064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 98/183] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:49:09 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:49:09.638473 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:09.638989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:09.645595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.646046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.648623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:09.648623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:09.765305 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-45029157-de01-4fc3-839b-ef4586a203fa tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.131238 Jul 12 18:49:09.765912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 99/184] 10.222.0.59 () {60 vars in 1315 bytes} [Tue Jul 12 18:49:09 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 12 18:49:10.431414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1699e675-eb76-4d74-ac7a-7424daead4f2 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "POST /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141649 Jul 12 18:49:10.432231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 86/185] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:49:09 2022] POST /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:11.402675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-68882373-2f81-4735-9e70-3f3c0002dd85 req-93fcf518-05d9-4fb0-885a-9c46d7ad773e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:11.413360 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-68882373-2f81-4735-9e70-3f3c0002dd85 req-93fcf518-05d9-4fb0-885a-9c46d7ad773e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:11.413997 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-68882373-2f81-4735-9e70-3f3c0002dd85 req-93fcf518-05d9-4fb0-885a-9c46d7ad773e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:11.419476 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:49:11.427181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-68882373-2f81-4735-9e70-3f3c0002dd85 req-93fcf518-05d9-4fb0-885a-9c46d7ad773e service nova] Creating event network-changed:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:49:11.433346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-68882373-2f81-4735-9e70-3f3c0002dd85 req-93fcf518-05d9-4fb0-885a-9c46d7ad773e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035045 Jul 12 18:49:11.433954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 100/186] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:43.647826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:43.647826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:43.655648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=39 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:49:43.655648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:49:43.659022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:43.659705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:43.661084 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:43.661634 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:43.716401 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:49:44.101519 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-90a32420-0f28-4c4f-9715-e5a2d0732f5d tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 204 len: 0 microversion: 2.1 time: 0.466710 Jul 12 18:49:44.102429 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 87/187] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:49:43 2022] DELETE /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:49:44.108138 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=23 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:49:44.115012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:44.115012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:44.124241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:44.125019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:44.125966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:44.126799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:44.318886 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:44.344195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-904274dc-5d41-409a-aeaf-2aa79f3b5601 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.235232 Jul 12 18:49:44.354605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 101/188] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:44 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:49:45.363705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:45.364544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:45.373267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:45.373724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:45.374799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:45.375224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:45.559948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:45.568344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bd40c247-47df-4c7d-9911-9401e8d59206 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.208953 Jul 12 18:49:45.569338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 88/189] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:45 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:46.585697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:46.588884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:46.593093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:46.593547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:46.594313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:46.594747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:46.770087 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:46.779269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cc657f78-b97e-4827-b27f-82fac0314606 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.197512 Jul 12 18:49:46.779877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 102/190] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:46 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:47.797678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:47.798364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:47.804964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:47.805480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:47.806260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:47.806695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:47.958104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:47.969012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-33efe74f-a9ef-4ac2-bb2d-f326f8c8d2b3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.175047 Jul 12 18:49:47.969012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 89/191] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:47 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:48.985977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:48.986646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:48.993136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:48.993641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:48.994338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:48.994767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:49.133168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:49.141618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0fdd8b3c-28cc-4755-a4dd-3f89035e8d36 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.159516 Jul 12 18:49:49.142201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 103/192] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:48 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:50.159321 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:50.159871 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:50.166363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:50.166808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:50.167600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:50.168037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:50.299569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:50.307559 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b7090dfc-a3e8-40da-b406-d6c2ef86d01a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.152208 Jul 12 18:49:50.308126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 90/193] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:50 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:51.324209 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:51.325175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:51.331524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:51.332004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:51.332778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:51.333216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:51.470909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:51.478927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1d893f4a-5e7d-410e-9f16-a8b75e8024c8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1553 microversion: 2.1 time: 0.158494 Jul 12 18:49:51.479592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 104/194] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:51 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:51.696942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-499186d3-51c2-4d34-a78b-656d89cfe72c req-5c854849-77b2-4314-af8d-90913a173f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f154772-6468-47ec-b129-a4ff742f313c", "name": "network-vif-unplugged", "status": "completed", "tag": "3996c8e9-ae7a-40e0-871a-ea93d7a9bce6"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:51.721816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-499186d3-51c2-4d34-a78b-656d89cfe72c req-5c854849-77b2-4314-af8d-90913a173f5c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:51.721816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-499186d3-51c2-4d34-a78b-656d89cfe72c req-5c854849-77b2-4314-af8d-90913a173f5c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:51.721816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-499186d3-51c2-4d34-a78b-656d89cfe72c req-5c854849-77b2-4314-af8d-90913a173f5c service nova] Creating event network-vif-unplugged:3996c8e9-ae7a-40e0-871a-ea93d7a9bce6 for instance 0f154772-6468-47ec-b129-a4ff742f313c on hv-cinder-83538 Jul 12 18:49:51.729713 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-499186d3-51c2-4d34-a78b-656d89cfe72c req-5c854849-77b2-4314-af8d-90913a173f5c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036988 Jul 12 18:49:51.730692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 91/195] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:52.090715 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-7d64479c-21d9-4f4d-8f9d-5721a758a162 req-5bbcb04c-e3ba-4fad-ba1e-c34273a86da4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f154772-6468-47ec-b129-a4ff742f313c", "name": "network-vif-deleted", "tag": "3996c8e9-ae7a-40e0-871a-ea93d7a9bce6"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:49:52.099229 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7d64479c-21d9-4f4d-8f9d-5721a758a162 req-5bbcb04c-e3ba-4fad-ba1e-c34273a86da4 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:52.099675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7d64479c-21d9-4f4d-8f9d-5721a758a162 req-5bbcb04c-e3ba-4fad-ba1e-c34273a86da4 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:52.111761 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-7d64479c-21d9-4f4d-8f9d-5721a758a162 req-5bbcb04c-e3ba-4fad-ba1e-c34273a86da4 service nova] Creating event network-vif-deleted:3996c8e9-ae7a-40e0-871a-ea93d7a9bce6 for instance 0f154772-6468-47ec-b129-a4ff742f313c on hv-cinder-83538 Jul 12 18:49:52.116929 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-7d64479c-21d9-4f4d-8f9d-5721a758a162 req-5bbcb04c-e3ba-4fad-ba1e-c34273a86da4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030541 Jul 12 18:49:52.117613 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 105/196] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:49:52.498534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:52.499239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:52.505845 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:52.506298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:52.507067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:52.507534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:52.572871 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:52.581730 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-434d5924-4592-4ec5-95a7-3df5fcccd39a tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1346 microversion: 2.1 time: 0.088531 Jul 12 18:49:52.582397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 92/197] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:52 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:53.600651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:53.601378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:53.608529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:53.608975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:53.609827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:53.610177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:53.672872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:53.681268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9e75220a-0b6a-4eed-bb4b-3a65b1b26dc8 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1346 microversion: 2.1 time: 0.084829 Jul 12 18:49:53.681878 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 106/198] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:53 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:54.699364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:54.700800 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:54.707859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:54.708533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:54.709694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:54.710274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:54.744348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:54.744929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:54.745479 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lazy-loading 'fault' on Instance uuid 0f154772-6468-47ec-b129-a4ff742f313c {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:49:54.798947 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3687d8518bec45a08e1682d8675ca7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72abacc31aec413ab443150dcdf1bdce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:49:54.807547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-36705ed3-095e-4141-9958-fd7f56ae3030 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 200 len: 1351 microversion: 2.1 time: 0.112179 Jul 12 18:49:54.808537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 93/199] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:54 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:49:55.825460 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:55.826806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:55.836764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:55.837717 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:55.839031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:55.840116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:55.860371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] HTTP exception thrown: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Request method failure captured: Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c HTTP/1.1 Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHdScHTzoxZZpz2euZLYQ8gD4Y8_tnn4E5POtfSGGJPhxQ7BwfOLonxYfPnbdhhb7E5bj4R8bOyLu5I1fJ4TC7_g4oTf-kxcijKahupp8EWJdbRlUQbsZCBWSMH3gKNJ5FyxeD_vDXqRlBehP5hiJ9EK_h0mC1u2hNpkrDePnXrqdo Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:49:55.865072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72abacc31aec413ab443150dcdf1bdce", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 3687d8518bec45a08e1682d8675ca7c1 Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:55.866639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '0f154772-6468-47ec-b129-a4ff742f313c'} Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:49:55.867515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:55.868921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:49:55.870197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Returning 404 to user: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:49:55.870197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-36498fc8-e1d3-4a06-af3f-ce2f6c4b50f3 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 404 len: 111 microversion: 2.1 time: 0.045980 Jul 12 18:49:55.870485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 107/200] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:49:55 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:49:55.982723 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:49:55.983745 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:49:55.991042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:55.991860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:55.992340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:49:55.992931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:49:56.006671 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] HTTP exception thrown: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Request method failure captured: Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c/os-volume_attachments HTTP/1.1 Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHdScHTzoxZZpz2euZLYQ8gD4Y8_tnn4E5POtfSGGJPhxQ7BwfOLonxYfPnbdhhb7E5bj4R8bOyLu5I1fJ4TC7_g4oTf-kxcijKahupp8EWJdbRlUQbsZCBWSMH3gKNJ5FyxeD_vDXqRlBehP5hiJ9EK_h0mC1u2hNpkrDePnXrqdo Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:49:56.014657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72abacc31aec413ab443150dcdf1bdce", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 3687d8518bec45a08e1682d8675ca7c1 Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:56.024513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'server_id': '0f154772-6468-47ec-b129-a4ff742f313c'} Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:49:56.026072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:49:56.029247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:49:56.033273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Returning 404 to user: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:49:56.033273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7a201386-1aca-4956-b565-17a8db5a750f tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039298 Jul 12 18:49:56.033273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 94/201] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:49:55 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:50:00.630192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:00.630797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:00.637245 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:00.638582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:00.639360 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:00.639802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:00.655776 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] HTTP exception thrown: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Request method failure captured: Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c HTTP/1.1 Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHdScHTzoxZZpz2euZLYQ8gD4Y8_tnn4E5POtfSGGJPhxQ7BwfOLonxYfPnbdhhb7E5bj4R8bOyLu5I1fJ4TC7_g4oTf-kxcijKahupp8EWJdbRlUQbsZCBWSMH3gKNJ5FyxeD_vDXqRlBehP5hiJ9EK_h0mC1u2hNpkrDePnXrqdo Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:50:00.657338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72abacc31aec413ab443150dcdf1bdce", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 3687d8518bec45a08e1682d8675ca7c1 Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.658678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '0f154772-6468-47ec-b129-a4ff742f313c'} Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:50:00.659397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.660693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.661969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Returning 404 to user: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:50:00.661969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-80fa6ca5-47f7-46c6-9d2c-dccb69c27d94 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 404 len: 111 microversion: 2.1 time: 0.032562 Jul 12 18:50:00.661969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 108/202] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:50:00 2022] DELETE /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:50:00.667771 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:00.668410 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] [instance: 0f154772-6468-47ec-b129-a4ff742f313c] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:00.676518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:00.678535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:00.678535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:00.678535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:00.694855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] HTTP exception thrown: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Request method failure captured: Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c HTTP/1.1 Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHdScHTzoxZZpz2euZLYQ8gD4Y8_tnn4E5POtfSGGJPhxQ7BwfOLonxYfPnbdhhb7E5bj4R8bOyLu5I1fJ4TC7_g4oTf-kxcijKahupp8EWJdbRlUQbsZCBWSMH3gKNJ5FyxeD_vDXqRlBehP5hiJ9EK_h0mC1u2hNpkrDePnXrqdo Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:50:00.697083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_72abacc31aec413ab443150dcdf1bdce", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/72abacc31aec413ab443150dcdf1bdce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 72abacc31aec413ab443150dcdf1bdce Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-DeleteServersTestJSON-1551299366 Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 3687d8518bec45a08e1682d8675ca7c1 Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-DeleteServersTestJSON-1551299366-project Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.698515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '0f154772-6468-47ec-b129-a4ff742f313c'} Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:50:00.699448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. Jul 12 18:50:00.700755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:50:00.701812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] Returning 404 to user: Instance 0f154772-6468-47ec-b129-a4ff742f313c could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:50:00.701812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ef4f6b96-2a4e-4622-92cd-f26e032a8161 tempest-DeleteServersTestJSON-1551299366 tempest-DeleteServersTestJSON-1551299366-project] 10.222.0.59 "GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c" status: 404 len: 111 microversion: 2.1 time: 0.034711 Jul 12 18:50:00.701812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 95/203] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:00 2022] GET /compute/v2.1/servers/0f154772-6468-47ec-b129-a4ff742f313c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:50:14.521606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=16 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:14.522816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=36 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:14.666153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-309427998", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:14.748172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] validate_networks() for [('25e3b490-65f8-4436-9faa-e84f2e3a2650', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:50:15.330736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:50:15.330736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:50:15.330736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:50:15.330736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:50:15.330736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:50:15.340055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:15.340512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:15.342151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:15.342665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:15.366601 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:50:15.370871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for user 56363156a2b046fca40df895b3f6a050 and project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:50:15.383296 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:50:15.386047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:50:15.541527 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6b8e83b5-8998-4b2e-b38f-9e19e5afdc20 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.026860 Jul 12 18:50:15.542867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 109/204] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:50:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:50:15.554553 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c79df4e4-1653-4006-9bd3-a2bb6a054af0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:15.555170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c79df4e4-1653-4006-9bd3-a2bb6a054af0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:15.562771 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:15.565375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:15.636023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c79df4e4-1653-4006-9bd3-a2bb6a054af0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:15.648510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c79df4e4-1653-4006-9bd3-a2bb6a054af0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1221 microversion: 2.1 time: 0.097787 Jul 12 18:50:15.649333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 96/205] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:15 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:15.856060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-448916625", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:15.933978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] validate_networks() for [('25e3b490-65f8-4436-9faa-e84f2e3a2650', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:50:16.393332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:50:16.393856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:50:16.394549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:50:16.395418 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:50:16.396535 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:50:16.407086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:16.407687 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:16.408697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:16.409941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:16.428384 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:50:16.432725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for user 56363156a2b046fca40df895b3f6a050 and project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:50:16.445762 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:50:16.448108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:50:16.667622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ba9f797c-5bc6-4d94-b37e-d48ca33fa0b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.816118 Jul 12 18:50:16.669533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 110/206] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:50:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:50:16.683070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cfcaaa47-52ec-4897-a0c1-14ac7c8b68ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:16.683856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cfcaaa47-52ec-4897-a0c1-14ac7c8b68ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:16.779066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cfcaaa47-52ec-4897-a0c1-14ac7c8b68ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:16.788866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cfcaaa47-52ec-4897-a0c1-14ac7c8b68ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1221 microversion: 2.1 time: 0.110834 Jul 12 18:50:16.790150 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 97/207] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:16 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:17.806665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:17.807803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:17.819323 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:17.820149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:17.821128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:17.821752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:17.974591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:17.984230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-62433db9-b039-462a-937c-8baf79d4bcc6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1225 microversion: 2.1 time: 0.181649 Jul 12 18:50:17.986438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 111/208] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:17 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:19.003343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:19.004184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:19.027445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:19.031231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:19.038123 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:19.038653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:19.118689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:19.126775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2ddcead0-2f0f-4338-a650-566843b6c368 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1273 microversion: 2.1 time: 0.127667 Jul 12 18:50:19.127507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 98/209] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:18 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:20.153019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:20.154168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:20.164381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:20.165118 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:20.166525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:20.167159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:20.266755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:20.275285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-830a2466-418a-422c-96a4-4a49bc3e41f5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1279 microversion: 2.1 time: 0.126167 Jul 12 18:50:20.276076 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 112/210] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:20 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:21.251549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-441e7dee-815c-4371-bd10-235f726d88cb req-925a49f3-0118-4b1a-9df5-8f6f4aec92a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e2ae99-c398-460c-a71b-c02a1e76c13e", "tag": "237c4a81-1ac3-4862-8876-ca6beae0569d"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:21.269104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-441e7dee-815c-4371-bd10-235f726d88cb req-925a49f3-0118-4b1a-9df5-8f6f4aec92a8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:21.270103 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-441e7dee-815c-4371-bd10-235f726d88cb req-925a49f3-0118-4b1a-9df5-8f6f4aec92a8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:21.293602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:21.294861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:21.299069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-441e7dee-815c-4371-bd10-235f726d88cb req-925a49f3-0118-4b1a-9df5-8f6f4aec92a8 service nova] Creating event network-changed:237c4a81-1ac3-4862-8876-ca6beae0569d for instance 99e2ae99-c398-460c-a71b-c02a1e76c13e on hv-cinder-83538 Jul 12 18:50:21.305899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:21.306373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:21.307156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:21.307633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:21.311876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-441e7dee-815c-4371-bd10-235f726d88cb req-925a49f3-0118-4b1a-9df5-8f6f4aec92a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064704 Jul 12 18:50:21.312489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 99/211] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:21.617964 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:21.629375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-04a3157d-948f-4b2c-8afc-3a0b27d9e950 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.340273 Jul 12 18:50:21.630854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 113/212] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:21 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:50:21.915656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-2f706160-c656-4e37-8982-d06abdd74140 req-3af8be49-b34d-4f50-8a95-4f0c7707eac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15adaf4d-81dd-4ada-9e5d-6c16735b22c8", "tag": "1e161cab-9e97-4d8e-9f6f-144fe879a320"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:21.928773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-2f706160-c656-4e37-8982-d06abdd74140 req-3af8be49-b34d-4f50-8a95-4f0c7707eac1 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:21.928773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-2f706160-c656-4e37-8982-d06abdd74140 req-3af8be49-b34d-4f50-8a95-4f0c7707eac1 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:21.985594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-2f706160-c656-4e37-8982-d06abdd74140 req-3af8be49-b34d-4f50-8a95-4f0c7707eac1 service nova] Creating event network-changed:1e161cab-9e97-4d8e-9f6f-144fe879a320 for instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 on hv-cinder-83538 Jul 12 18:50:21.990775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-2f706160-c656-4e37-8982-d06abdd74140 req-3af8be49-b34d-4f50-8a95-4f0c7707eac1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079854 Jul 12 18:50:21.991900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 100/213] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:22.647224 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:22.647877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:22.655137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:22.655826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:22.656751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:22.657344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:22.819232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:22.828752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e159f94d-586c-4c88-92f3-28511597b2a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.185265 Jul 12 18:50:22.829336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 114/214] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:22 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:23.848699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:23.850221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:23.861641 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:23.862249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:23.862970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:23.868039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:24.021885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:24.030738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-82a8edc9-a1bf-41e7-a82a-f2075615d1b3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.187858 Jul 12 18:50:24.031765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 101/215] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:23 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:25.047994 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:25.048732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:25.058444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:25.060099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:25.061872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:25.071556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:25.435608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:25.445017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9e66a10c-ed18-47d7-a9a3-b10a34352fa7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.400182 Jul 12 18:50:25.448208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 115/216] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:25 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:26.461644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:26.462258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:26.469615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:26.470068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:26.470929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:26.471551 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:26.619957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:26.638675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-41a8cf9f-4f41-4d90-88d8-0ad207d286a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.170656 Jul 12 18:50:26.638675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 102/217] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:26 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:27.645750 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:27.646299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:27.650067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=4 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:27.650897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=12 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:27.656024 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:27.656456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:27.657217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:27.658113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:27.898143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:27.911985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0d1f0367-ec56-4b76-9465-c56b0a48639a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.270580 Jul 12 18:50:27.922558 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 116/218] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:27 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:28.931695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:28.932319 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:28.935970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:28.942310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:28.943482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:28.944334 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:28.944774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:29.316387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:29.326489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-520708d2-d9de-48fb-aa1d-528f3c1094ac tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.399600 Jul 12 18:50:29.330358 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 103/219] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:28 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:30.346768 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:30.347407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:30.354686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:30.355418 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:30.357054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:30.357480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:30.556343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:30.570913 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eb4652da-65db-42c2-aa8f-efb7598bda2f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.228533 Jul 12 18:50:30.572036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 117/220] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:30 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:30.875176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-85a60c87-c682-42b9-b698-9e463a77262e req-ffb8ccd8-caa8-4f93-89c1-d224efe3598d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e2ae99-c398-460c-a71b-c02a1e76c13e", "name": "network-vif-plugged", "status": "completed", "tag": "237c4a81-1ac3-4862-8876-ca6beae0569d"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:30.887273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-85a60c87-c682-42b9-b698-9e463a77262e req-ffb8ccd8-caa8-4f93-89c1-d224efe3598d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:30.888384 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-85a60c87-c682-42b9-b698-9e463a77262e req-ffb8ccd8-caa8-4f93-89c1-d224efe3598d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:30.913729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-85a60c87-c682-42b9-b698-9e463a77262e req-ffb8ccd8-caa8-4f93-89c1-d224efe3598d service nova] Creating event network-vif-plugged:237c4a81-1ac3-4862-8876-ca6beae0569d for instance 99e2ae99-c398-460c-a71b-c02a1e76c13e on hv-cinder-83538 Jul 12 18:50:30.919710 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-85a60c87-c682-42b9-b698-9e463a77262e req-ffb8ccd8-caa8-4f93-89c1-d224efe3598d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048660 Jul 12 18:50:30.921054 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 104/221] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:31.662688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:31.662688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:31.662688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:31.662688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:31.663564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:31.663564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:31.896608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:31.896608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a46e510e-038e-4ad0-9fdf-5e1d24df26dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.204524 Jul 12 18:50:31.896608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 118/222] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:31 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:32.927561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:32.927561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:32.931665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:32.931665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:32.932015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:32.936630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:33.292177 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:33.303276 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9f8afe80-c270-4735-a9df-18c657578b7c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.390303 Jul 12 18:50:33.314486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 105/223] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:32 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:33.422037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-6f8b53e4-7798-4e5c-a44d-650cc0194d41 req-13cfc1c8-c177-4183-8fe4-6311ba9d1695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15adaf4d-81dd-4ada-9e5d-6c16735b22c8", "name": "network-vif-plugged", "status": "completed", "tag": "1e161cab-9e97-4d8e-9f6f-144fe879a320"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:33.433425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6f8b53e4-7798-4e5c-a44d-650cc0194d41 req-13cfc1c8-c177-4183-8fe4-6311ba9d1695 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:33.434261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6f8b53e4-7798-4e5c-a44d-650cc0194d41 req-13cfc1c8-c177-4183-8fe4-6311ba9d1695 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:33.460871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-6f8b53e4-7798-4e5c-a44d-650cc0194d41 req-13cfc1c8-c177-4183-8fe4-6311ba9d1695 service nova] Creating event network-vif-plugged:1e161cab-9e97-4d8e-9f6f-144fe879a320 for instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 on hv-cinder-83538 Jul 12 18:50:33.468554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-6f8b53e4-7798-4e5c-a44d-650cc0194d41 req-13cfc1c8-c177-4183-8fe4-6311ba9d1695 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051216 Jul 12 18:50:33.469735 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 119/224] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:34.322587 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:34.323193 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:34.330083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:34.330530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:34.331295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:34.331764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:34.825776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:34.835455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5f566491-41d4-4fc0-bc0f-29c551f3acfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.516523 Jul 12 18:50:34.845907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 106/225] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:34 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:35.854441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:35.855330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:35.862911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:35.863729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:35.864996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:35.866917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:36.046930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:36.055238 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ae750866-82a4-4823-b7b2-e9c709c3a68d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1321 microversion: 2.1 time: 0.205001 Jul 12 18:50:36.066053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 120/226] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:35 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:37.072565 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:37.073169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:37.081530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.089666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:37.092756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.092756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:37.307928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:37.317662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3482ee1c-19e3-4b00-a5dd-83b7877b4621 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1516 microversion: 2.1 time: 0.248862 Jul 12 18:50:37.318662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 107/227] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:37 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:37.338021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:37.339078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:37.347797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.348326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:37.349252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.349808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:37.390177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'flavor' on Instance uuid 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:50:37.815830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1aef61b6-c9eb-4b88-b7ba-ce0931161061 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8/action" status: 200 len: 32 microversion: 2.1 time: 0.482883 Jul 12 18:50:37.817960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 121/228] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:50:37 2022] POST /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8/action => generated 32 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:50:37.838715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:37.839521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:37.852494 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.855919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:37.859418 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:37.860170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:38.057932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:38.070021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a1ace41b-fe0f-4617-bc1b-db9ae1244547 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.247192 Jul 12 18:50:38.070930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 108/229] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:37 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:50:39.097021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:39.097021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:39.100760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:39.100760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:39.100760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:39.100760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:39.256506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:39.272889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4108abe2-3002-4cb4-8c4a-3b0c8bc0b61e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.188011 Jul 12 18:50:39.283358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 122/230] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:39 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:40.290151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:40.291647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:40.301342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:40.305339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:40.305339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:40.305339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:40.476203 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:40.485589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2b957d1d-0f5d-4fb2-bf06-28cad67d96f2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.199374 Jul 12 18:50:40.487222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 109/231] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:40 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:41.503808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:41.504417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:41.512050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:41.512623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:41.514505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:41.514946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:41.721098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:41.729290 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6ca81afb-17a9-4475-8220-3e78aed633f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.230894 Jul 12 18:50:41.730408 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 123/232] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:41 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:42.746963 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:42.751453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:42.760763 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:42.761504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:42.762754 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:42.763485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:43.005278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:43.014930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f189f911-f82e-4d08-9156-113abacbc835 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.271754 Jul 12 18:50:43.016336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 110/233] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:42 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:44.033906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:44.036045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:44.043063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:44.044647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:44.045495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:44.046228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:44.199113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:44.208296 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e991a287-efbc-4db7-927c-4d25d9608e80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.180704 Jul 12 18:50:44.208979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 124/234] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:44 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:45.226434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:45.230586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:45.234816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:45.235258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:45.236064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:45.236496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:45.397279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:45.411186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-77945235-578f-440a-8155-b1dc471a8c40 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.188449 Jul 12 18:50:45.412708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 111/235] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:45 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:46.436236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:46.436850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:46.442317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:46.445113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:46.445888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:46.446667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:46.447094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:46.450959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:46.604464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:46.615079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4d3e6b82-fd87-4be8-957d-b8c743dfbd60 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.183572 Jul 12 18:50:46.623976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 125/236] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:46 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:47.634269 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:47.634877 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:47.642141 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:47.642617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:47.643474 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:47.644092 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:47.810147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:47.818312 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4011866e-8f9f-42ce-a15f-86e4efe4900d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.188158 Jul 12 18:50:47.818890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 112/237] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:47 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:48.838829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:48.839496 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:48.846969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:48.850257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:48.851432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:48.851881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:49.008387 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:49.018075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0c6f005a-8322-4dbf-85e6-9b287eac729b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.186719 Jul 12 18:50:49.018810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 126/238] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:48 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:49.541178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-69b032f5-ea5c-4238-bf52-db61eb6dfa7c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'create', calling method: .version_select at 0x7f01787d2280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-949100624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOHZ31v9lx+O+TtoX6bOqOOrHvqyIgfOaOoi+gOA4xoIEOw1IQUdJ7wj4Z5elIGiM5rtt3L9kxD4M8NNzGmfmoVOwbeaqrWJa2KIH5uEWxgbJRuA6erMbhD9HgvhoaCxwQ=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:49.546320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=39 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:49.556916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-69b032f5-ea5c-4238-bf52-db61eb6dfa7c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Getting quotas for project 173966e9a1ae48f88fd80f82c81f1079. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:50:49.560769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-69b032f5-ea5c-4238-bf52-db61eb6dfa7c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Getting quotas for user fac20f65ef844175927f0b7ea9fd14b9 and project 173966e9a1ae48f88fd80f82c81f1079. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:50:49.675081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-69b032f5-ea5c-4238-bf52-db61eb6dfa7c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.137682 Jul 12 18:50:49.675905 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 113/239] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:50:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:49.730178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1009852228", "imageRef": "85ac54e9-baaf-4ab1-a9b2-dd89c8608070", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-949100624", "networks": [{"uuid": "fc99f061-ff23-49dd-b366-305a689de6a5"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:50:49.782731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] validate_networks() for [('fc99f061-ff23-49dd-b366-305a689de6a5', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:50:50.035675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:50.036824 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:50.043777 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:50.044251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:50.052255 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:50.052717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:50.267127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:50:50.267693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:50:50.268105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:50:50.268518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:50:50.268932 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:50:50.272525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:50.281616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:50.281616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:50.281616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:50.281897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a7acfc08-5fdb-4994-b272-b1774c08a115 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.248428 Jul 12 18:50:50.281999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:50.282085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 114/240] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:50 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:50.298451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Getting quotas for project 173966e9a1ae48f88fd80f82c81f1079. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:50:50.302513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Getting quotas for user fac20f65ef844175927f0b7ea9fd14b9 and project 173966e9a1ae48f88fd80f82c81f1079. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:50:50.315393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:50:50.317631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85ac54e9-baaf-4ab1-a9b2-dd89c8608070',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:50:50.475203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8d594096-d007-4911-a13b-7aad753daae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748739 Jul 12 18:50:50.475906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 127/241] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:50:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:50:50.487214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e8caaa1b-0a62-476a-8411-8e8c84a3cf97 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:50.488101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e8caaa1b-0a62-476a-8411-8e8c84a3cf97 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:50.545853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e8caaa1b-0a62-476a-8411-8e8c84a3cf97 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:50.553124 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e8caaa1b-0a62-476a-8411-8e8c84a3cf97 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1258 microversion: 2.1 time: 0.070211 Jul 12 18:50:50.554612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 115/242] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:50 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:51.296788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:51.297494 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:51.306295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:51.306880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:51.307525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:51.308116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:51.457738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:51.465508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-39a9132e-7559-4ce2-9efa-d947b08607c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.172684 Jul 12 18:50:51.466807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 128/243] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:51 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:51.571754 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:51.572371 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:51.580902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:51.581355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:51.582297 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:51.582738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:51.587150 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=85 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:50:51.649455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:51.657002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2659a514-050e-4fa1-a81e-44dc6d359685 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1262 microversion: 2.1 time: 0.089114 Jul 12 18:50:51.657555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 116/244] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:51 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:50:52.066824 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:52.067358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:52.073316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.073756 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.074526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.074949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.097347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8f5f71e1-ee0f-4409-bcc7-1df61ca51502 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/ips" status: 200 len: 147 microversion: 2.1 time: 0.034324 Jul 12 18:50:52.097913 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 129/245] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:50:52 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:50:52.489100 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:52.489708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:52.496481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.496933 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.497788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.498224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.629997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:52.637449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-afebc8d9-49dc-47f9-a083-b7a8dc03a3df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.152450 Jul 12 18:50:52.638708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 117/246] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:52 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:52.673880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:52.674487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:52.680517 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.680961 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.681713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:52.682145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:52.742757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:52.750608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7cb84eee-656f-4f6c-b596-2400db76b2b8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1262 microversion: 2.1 time: 0.080555 Jul 12 18:50:52.751184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 130/247] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:52 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:53.655778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:53.666810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:53.666810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:53.666810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:53.666810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:53.667215 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:53.768576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:53.769213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:53.775520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:53.775964 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:53.776722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:53.777159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:53.797959 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:53.805449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-415e4a81-deea-4436-bea8-82fa396f4a3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.154143 Jul 12 18:50:53.806015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 118/248] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:53 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:53.837783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:53.845994 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-45168515-aee8-4222-813a-fadb97ab2d4e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1262 microversion: 2.1 time: 0.081646 Jul 12 18:50:53.846814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 131/249] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:53 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:54.822690 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:54.823370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:54.830545 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:54.830923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:54.831729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:54.832162 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:54.863027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:54.863830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:54.869986 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:54.870436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:54.872432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:54.872432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:54.948592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:54.956600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0be49562-f710-44f7-bd9e-eb8ccb1f0377 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1262 microversion: 2.1 time: 0.097363 Jul 12 18:50:54.957170 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 132/250] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:54 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1262 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:50:54.987236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:54.994543 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-13f3811a-2b26-40dd-adad-8f0ea2479a9c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.175774 Jul 12 18:50:54.995094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 119/251] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:54 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:55.972594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:55.973224 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:55.979511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:55.979954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:55.980711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:55.981146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:56.012004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:56.012752 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:56.020243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:56.020697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:56.021476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:56.021911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:56.044569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:56.052749 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-290e7b48-d942-4867-b939-046df68c076e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1310 microversion: 2.1 time: 0.084503 Jul 12 18:50:56.053348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 133/252] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:55 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:56.157279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:56.164653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-03a1e7c7-55cd-4028-b1f7-741f0905abe7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.156796 Jul 12 18:50:56.165217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 120/253] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:56 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:56.759344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:56.759845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:56.766684 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:56.767389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:56.768356 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:56.769082 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:56.793261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-142d8171-cd08-4f3e-9b11-0dbe4fc9a7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/ips" status: 200 len: 152 microversion: 2.20 time: 0.037879 Jul 12 18:50:56.793881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 134/254] 10.222.0.59 () {60 vars in 1288 bytes} [Tue Jul 12 18:50:56 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:50:57.069394 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:57.071484 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:57.078966 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:57.079217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:57.080032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:57.080700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:57.163986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:57.172562 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3f704c27-e70e-44f9-acd8-9efb909d0334 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1316 microversion: 2.1 time: 0.106112 Jul 12 18:50:57.181660 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 121/255] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:57 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1316 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:57.182382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:57.183025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:57.190464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:57.192505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:57.192505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:57.192505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:57.521068 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:57.533697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3aa21106-cc90-4b29-8847-b998192a4e86 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.355401 Jul 12 18:50:57.534885 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 135/256] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:57 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:58.189561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:58.190338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:58.197643 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:58.198087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:58.199059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:58.199700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:58.360703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:58.368821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-72890b84-102f-4e06-a46a-86daf38164db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.184162 Jul 12 18:50:58.371352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 122/257] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:58 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:58.553176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:58.553176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:58.558947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:58.559440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:58.560231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:58.560678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:58.709010 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:58.717118 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-220dcb3c-90f6-4e91-a941-9829abfdc329 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.169079 Jul 12 18:50:58.717679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 136/258] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:58 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:59.387507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:59.388834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:59.396439 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:59.396883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:59.397652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:59.398076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:59.529222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:59.537829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6d2dfcc2-1332-4e4c-949d-77f68723a1d5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.154347 Jul 12 18:50:59.538437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 123/259] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:59 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:50:59.736001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:50:59.736623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:50:59.742766 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:59.743213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:59.744008 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:50:59.744447 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:50:59.884475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:50:59.892480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-73fcb17a-fa8e-4f64-88fc-f4bf251f23af tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.161528 Jul 12 18:50:59.893290 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 137/260] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:50:59 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:00.554619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:00.555397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:00.557705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:00.562964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:00.563579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:00.564342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:00.564773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:00.705031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:00.721834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2cf6cd50-f836-4060-80d8-d888020d755b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.170976 Jul 12 18:51:00.725628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 124/261] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:00 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:00.910611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:00.911315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:00.913383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:00.914129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:00.918974 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:00.919459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:00.920232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:00.920666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:01.051590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0349873c-ca38-4d04-9e1f-86d4682591b1"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:01.052715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:01.058879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:01.059342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:01.060158 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:01.060584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:01.092464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:01.101814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eaf8cb3f-2ce9-4a11-a09e-6bb34235991f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.196223 Jul 12 18:51:01.113493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 138/262] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:00 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:01.746417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:01.747078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:01.754975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:01.755865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:01.756817 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:01.757406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:01.894690 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:01.904014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-79a83731-5c11-4630-934a-e26af7c8f113 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.161430 Jul 12 18:51:01.905029 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 139/263] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:01 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:02.119347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:02.120056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:02.126544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:02.127157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:02.128359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:02.128938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:02.268396 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:02.278486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6cd7f5c8-c96c-4590-89ce-22e92b6f00b9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.163050 Jul 12 18:51:02.300041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 140/264] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:02 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:02.921175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:02.921944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:02.986080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:02.986080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:02.986080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:02.986080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:03.092385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:03.100069 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-db330481-d26e-4d7e-aceb-802e4a57b06e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.182911 Jul 12 18:51:03.101073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 141/265] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:02 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:03.297519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:03.298258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:03.304467 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:03.304907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:03.305662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:03.306091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:03.459596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:03.466946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5530d7a2-392d-4d2a-9e63-aa9d98ddafab tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.173328 Jul 12 18:51:03.468043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 142/266] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:03 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:03.473674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:03.474114 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:03.480279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:03.480712 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:03.481648 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:03.482217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:03.486749 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:03.508907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lazy-loading 'flavor' on Instance uuid a96074e1-9b57-4f07-8745-60c7e8446aa9 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:51:04.153383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f6c17840-1e80-4b5e-81e6-c7b6ba633aec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/action" status: 202 len: 0 microversion: 2.20 time: 0.683818 Jul 12 18:51:04.154119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 143/267] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Jul 12 18:51:03 2022] POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/action => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:51:04.162014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:04.162014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:04.167264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.167740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.168573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.168994 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.398989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:04.407279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d336d7e0-2ab5-40cb-9e7e-01e7e97897c1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.252067 Jul 12 18:51:04.408451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 144/268] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:04 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:04.413522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:04.414256 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:04.420515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.421026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.421845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.422337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.570014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:04.578472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:04.580162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:04.581216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b9108479-d693-4440-9194-423b80bc0f0c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.171609 Jul 12 18:51:04.581775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 145/269] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:04 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:04.586688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:04.587279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:04.593549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.594007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.606888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:04.607816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:04.849425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:04.859403 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a0b51ee7-2f93-407d-b266-94b4f339ea54 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.276569 Jul 12 18:51:04.859993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 146/270] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:04 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:05.425151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:05.426529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:05.443160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:05.443929 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:05.444705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:05.445134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:05.722590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:05.730375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-86bb8e50-8676-47f9-9764-4d600294cd52 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.309105 Jul 12 18:51:05.732169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 147/271] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:05 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:05.737958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:05.738735 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:05.745505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:05.746039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:05.746887 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:05.747437 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:05.952728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:05.975968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:05.977873 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:05.979657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-246dbf83-031a-4a0d-82b5-7a8929699565 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.246130 Jul 12 18:51:05.980392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 148/272] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:05 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:05.985266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:05.987754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:05.994439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:06.000083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:06.000083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:06.000083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:06.155848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:06.169937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1f579f2a-24cf-44b2-9ba7-70b6f18326b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.188051 Jul 12 18:51:06.179260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 149/273] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:05 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:06.748493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:06.749223 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:06.760634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:06.761093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:06.761892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:06.762330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:06.924565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:06.936844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dc75f254-87dd-43ca-8d3d-c3baf7860ae0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.191091 Jul 12 18:51:06.937448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 150/274] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:06 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:06.998045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:06.998654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:07.005059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.012346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:07.012346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.012346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:07.158097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:07.166191 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:07.167771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:07.168918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-73801533-9a1e-4bc4-95b4-fcec4a4bbbcf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.174772 Jul 12 18:51:07.169483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 151/275] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:06 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:07.190375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:07.191212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:07.200431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.200886 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:07.201730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.202177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:07.370939 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:07.378943 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f9a2efc9-2f7a-4409-9094-9e9aaf78fc0c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.194319 Jul 12 18:51:07.379548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 152/276] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:07 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:07.953918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:07.955272 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:07.963719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.963719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:07.963719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:07.963719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:08.103854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:08.113653 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-59cc4303-e3ff-43ae-ac91-61650723237f tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.163592 Jul 12 18:51:08.120225 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 153/277] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:07 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:08.187272 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:08.187971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:08.194875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:08.195345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:08.196112 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:08.196545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:08.357647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:08.366544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:08.368107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:08.369281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-374255ec-9b29-4088-96d4-fa82032353d7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.185824 Jul 12 18:51:08.369899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 154/278] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:08 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:08.399733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:08.400428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:08.406785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:08.407345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:08.408354 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:08.408871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:08.562037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:08.570901 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-98e2b5c3-e852-4a72-802b-4c4a1a24a78f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.174906 Jul 12 18:51:08.571509 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 155/279] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:08 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:09.132538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:09.133441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:09.139566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.140012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.140771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.141203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.269872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:09.277394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f7556735-3f40-44d2-bd62-3a4484d07047 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.148896 Jul 12 18:51:09.277955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 156/280] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:09 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:09.388896 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:09.389930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:09.396156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.396630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.397727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.398204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.533517 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:09.535856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:09.542183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:09.543719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:09.544844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e5069c93-d734-4268-81ba-cb3ceed38481 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.159873 Jul 12 18:51:09.545460 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 157/281] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:09 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:09.593562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:09.594187 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:09.601457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.601920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.602714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:09.603143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:09.762300 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:09.770778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-402b34d6-1162-4c46-ab2d-f82986fbe6ea tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.180940 Jul 12 18:51:09.780407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 158/282] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:09 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:10.295663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:10.296301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:10.303497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.303943 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.304694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.305127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.435695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:10.443152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ed1723ba-9494-4c22-82cc-6942d070cbbb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.151462 Jul 12 18:51:10.443755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 159/283] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:10 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:10.563117 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:10.563652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:10.569602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.570920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.570920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.571235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.699435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:10.708214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:10.714405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:10.714405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c5897d55-f9f6-443f-9c47-297ee4bfe272 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.151790 Jul 12 18:51:10.714405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 160/284] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:10 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:10.788030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:10.788641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:10.794580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.795026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.795825 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:10.796259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:10.924910 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:10.932471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1a2d97ef-f9cc-4307-aeb1-7c7334ce81df tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.148266 Jul 12 18:51:10.933034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 161/285] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:10 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:11.057216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:11.149910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=59 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:11.459588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:11.460103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:11.466199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.466648 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:11.467429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.467867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:11.602218 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:11.609656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-386924a6-9290-426e-90b7-6e4fa93154f2 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.154591 Jul 12 18:51:11.610222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 162/286] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:11 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:11.730006 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:11.730605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:11.737350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.737793 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:11.738671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.739026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:11.872296 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:11.880703 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:11.882279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:11.883453 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-13a8b4ca-1f35-41f0-b977-c6398202e88a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.157423 Jul 12 18:51:11.884016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 163/287] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:11 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:11.949703 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:11.950308 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:11.956850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.957291 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:11.958044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:11.958475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:12.089789 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:12.098003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-56bd3492-4501-4412-937e-5fa36d1136b5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.152055 Jul 12 18:51:12.098569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 164/288] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:11 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:12.627568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:12.628514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:12.634713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:12.635154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:12.635939 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:12.636368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:12.763675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:12.771635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f2668ab8-2a11-43ba-b94d-44fcb6ce04f8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.148548 Jul 12 18:51:12.772206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 165/289] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:12 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:12.902258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:12.902800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:12.911704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:12.912158 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:12.912930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:12.913366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:13.048851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:13.057465 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:13.058973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:13.060157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7192fe5b-f89e-4aee-96fb-8a7f5178853c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.162185 Jul 12 18:51:13.060716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 166/290] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:12 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:13.114167 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:13.114760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:13.116603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:13.121261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:13.121700 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:13.122442 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:13.122867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:13.250783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:13.259277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-941cbf3c-133b-4e70-af49-9968bbb97b4a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.149074 Jul 12 18:51:13.260305 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 167/291] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:13 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:13.788638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:13.789243 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:13.795259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:13.795738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:13.796485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:13.796914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:13.925418 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:13.932430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b7592d1a-8e58-4b2b-be35-8fbdb041838d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.147557 Jul 12 18:51:13.933108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 168/292] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:13 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:14.078112 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:14.078711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:14.085076 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.085568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:14.086392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.086841 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:14.322279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:14.331130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:14.332714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:14.333924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5d3b77ac-3d6f-4418-8c5b-8cc8545f9d28 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.259703 Jul 12 18:51:14.334486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 169/293] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:14 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:14.350385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:14.350990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:14.356973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.357412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:14.358172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.358597 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:14.565176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:14.575848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2c4ac1bb-b720-4a03-9530-ea27948c252c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.227997 Jul 12 18:51:14.575848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 170/294] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:14 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:14.949492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:14.950105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:14.956919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.957555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:14.958321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:14.958754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.057677 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5f24cca7-dbcd-4706-9e1f-e674ef80a101 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.010184 Jul 12 18:51:15.058163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 125/295] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:51:01 2022] POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments => generated 194 bytes in 14012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:51:15.074126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-69b7cf9e-c938-48a6-b45f-a0432cc2b9bd req-51d2f31b-9406-4af8-b91f-cb9c2b8d42f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:15.092623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-69b7cf9e-c938-48a6-b45f-a0432cc2b9bd req-51d2f31b-9406-4af8-b91f-cb9c2b8d42f4 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:15.093157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-69b7cf9e-c938-48a6-b45f-a0432cc2b9bd req-51d2f31b-9406-4af8-b91f-cb9c2b8d42f4 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.116674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-69b7cf9e-c938-48a6-b45f-a0432cc2b9bd req-51d2f31b-9406-4af8-b91f-cb9c2b8d42f4 service nova] Creating event network-changed:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:51:15.122861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-69b7cf9e-c938-48a6-b45f-a0432cc2b9bd req-51d2f31b-9406-4af8-b91f-cb9c2b8d42f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055218 Jul 12 18:51:15.124532 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 126/296] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:15.144467 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:15.152362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f3e764dc-7e9c-4790-86e9-7b9801e86a44 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.206700 Jul 12 18:51:15.152942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 171/297] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:14 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:15.353769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:15.354656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:15.364891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:15.364891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.364891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:15.364891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.592454 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:15.593042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:15.600212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:15.600652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.601417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:15.601846 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:15.851459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:15.859707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:15.861248 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:15.862767 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9fbf17f8-6560-456a-88bc-96fb99312baf tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.513332 Jul 12 18:51:15.863671 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 127/298] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:15 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:15.897387 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:15.905592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-296f63f9-908a-4f93-b949-0f8e70338003 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.317133 Jul 12 18:51:15.906341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 172/299] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:15 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:16.176061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:16.176061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:16.180527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.181194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:16.182284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.182925 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:16.409643 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:16.417437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-69d03545-0d44-447c-b57f-1a026e95a58a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.252046 Jul 12 18:51:16.417941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 128/300] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:16 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:16.881594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:16.882194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:16.888365 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.888845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:16.889633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.890066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:16.924388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:16.926099 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:16.936019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.936666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:16.937848 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:16.938282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:17.077294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:17.086475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:17.088459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:17.089616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6960af13-26ef-4197-9c99-8b86a65dd155 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.212305 Jul 12 18:51:17.090530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 173/301] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:16 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:17.109351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:17.117261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d0c8c7d8-e987-45ca-b7e2-50d18b4f6f9f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.197578 Jul 12 18:51:17.117837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 129/302] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:16 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:17.435468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:17.436005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:17.442544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:17.443109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:17.443898 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:17.444336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:17.459608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:17.579706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:17.588529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-412445a7-bce9-4ffd-af31-4ba189e3a8f7 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.157032 Jul 12 18:51:17.589097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 174/303] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:17 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:18.109227 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:18.109791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:18.117194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.117646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.118405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.118842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.134778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:18.135416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:18.141294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.141732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.142479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.142904 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.321198 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:18.329931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:18.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:18.339089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-45bd9fa3-d0de-4c32-b937-5ad53e4d618a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.227376 Jul 12 18:51:18.339089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 130/304] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:18 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:18.355666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:18.364099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-432cac39-eb42-4c88-902b-86b470a61a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.233153 Jul 12 18:51:18.364598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 175/305] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:18 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:18.605800 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:18.606405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:18.612383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.613464 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.614381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:18.614763 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:18.750050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:18.758595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-233de473-118c-48d9-b6ea-6c6b97e743f1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.156572 Jul 12 18:51:18.759154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 131/306] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:18 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:19.356978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:19.357814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:19.364750 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.365319 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.366041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.366476 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.384295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:19.384295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:19.389207 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.389744 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.390704 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.391220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.563143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:19.573530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:19.576816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:19.582678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:19.583911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d2c0437d-d55b-406c-bb4d-ea7d59a3e691 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.231087 Jul 12 18:51:19.584605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 176/307] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:19 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:19.594718 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7239fd4f-a291-45ae-9fa4-f45d525611ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.217977 Jul 12 18:51:19.595472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 132/308] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:19 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:19.776350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:19.777348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:19.784785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.785267 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.786039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:19.786483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:19.918704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:19.926583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5ca8f8bd-253e-4b24-a6b4-825bbebfd790 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.154393 Jul 12 18:51:19.927194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 177/309] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:19 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:20.603461 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:20.604064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:20.610774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.616161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:20.616161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.616522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:20.616943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:20.617038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:20.620310 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.620761 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:20.621526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.621961 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:20.813044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:20.816796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:20.823411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-01b3c8c6-cb66-4b5c-974e-a7fe534591c4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.215006 Jul 12 18:51:20.824500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 178/310] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:20 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:20.834885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:20.836543 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:20.838053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-123647e0-602b-4cd4-ac4d-c2da7b66be13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.238538 Jul 12 18:51:20.838834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 133/311] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:20 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:20.945368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:20.946135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:20.954433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.955011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:20.956113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:20.959805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:21.144468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:21.151947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-50711862-8f87-4a04-9235-e12c4e3bdf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.212549 Jul 12 18:51:21.152518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 179/312] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:20 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:21.670908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:51:21.671457 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 18:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:51:21.807968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:51:21.808568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 18:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:51:21.840139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:21.840761 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:21.850590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:21.851050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:21.851872 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:21.852505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:21.864745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:21.866890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:21.877326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:21.878373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:21.881387 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:21.882111 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:22.112244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:22.120595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3674af7f-adc8-46ba-85db-cd62d924360d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.284381 Jul 12 18:51:22.121164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 134/313] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:21 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:22.160466 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:22.168867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:22.169410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:22.169735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:22.170963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:22.172148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-06c2f7b9-ec7b-4bd7-af7c-1d9d79f039e2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.314471 Jul 12 18:51:22.172687 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 180/314] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:21 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:22.176796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:22.177294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:22.178159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:22.178653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:22.355013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:22.362431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fa7289b1-779d-405a-9eb6-bf652f5e4aef tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.197521 Jul 12 18:51:22.363057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 135/315] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:22 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:23.053648 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-1fc8f2f2-289b-40e9-8f0e-3b68fa3bf2cb req-4dcc0a1f-ad82-4c22-a929-faa1967abe02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "name": "network-vif-plugged", "status": "completed", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:23.063728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-1fc8f2f2-289b-40e9-8f0e-3b68fa3bf2cb req-4dcc0a1f-ad82-4c22-a929-faa1967abe02 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.064344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-1fc8f2f2-289b-40e9-8f0e-3b68fa3bf2cb req-4dcc0a1f-ad82-4c22-a929-faa1967abe02 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.076988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-1fc8f2f2-289b-40e9-8f0e-3b68fa3bf2cb req-4dcc0a1f-ad82-4c22-a929-faa1967abe02 service nova] Creating event network-vif-plugged:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:51:23.082263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-1fc8f2f2-289b-40e9-8f0e-3b68fa3bf2cb req-4dcc0a1f-ad82-4c22-a929-faa1967abe02 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034425 Jul 12 18:51:23.082839 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 181/316] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:23.137943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:23.139173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:23.146091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.146538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.147322 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.147760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.193840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:23.194823 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:23.202639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.203239 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.204317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.204866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.387131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:23.398591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:23.401726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:23.403192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ad5c5e2f-065a-4adb-89ab-cb5c5cfe9f68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.215135 Jul 12 18:51:23.408903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 182/317] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:23 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:23.410107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:23.410932 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:23.419900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.420606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.422601 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.423274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.557563 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:23.575874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f613e42f-5724-4620-a0af-8b767d1527f3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.441529 Jul 12 18:51:23.578434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 136/318] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:23 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:23.690089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2fd0cc7e-3c2b-4b2b-925e-696304c22dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:23.696530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fd0cc7e-3c2b-4b2b-925e-696304c22dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.697053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fd0cc7e-3c2b-4b2b-925e-696304c22dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.760469 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2fd0cc7e-3c2b-4b2b-925e-696304c22dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Going to try to stop instance {{(pid=124970) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 18:51:23.781719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:23.794549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9612a60e-f3b6-4a85-aad4-97103776cf8b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.388926 Jul 12 18:51:23.795100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 183/319] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:23 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:23.968668 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2fd0cc7e-3c2b-4b2b-925e-696304c22dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action" status: 202 len: 0 microversion: 2.1 time: 0.282680 Jul 12 18:51:23.969265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 137/320] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:51:23 2022] POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:51:23.977923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:23.978528 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:23.984664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.985111 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:23.985863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:23.986342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.125801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.134741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b25a69ab-21aa-4f1f-b377-a201a1be06ba tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.160594 Jul 12 18:51:24.135421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 184/321] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:23 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:24.427188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:24.428025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:24.434438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.434894 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.435729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.436164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.574673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.588031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.589672 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.591715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d3383f2c-5ee8-4cfe-92a9-ae65c78d5e19 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.169488 Jul 12 18:51:24.592271 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 138/322] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:24 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:24.596802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:24.597694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:24.604725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.605255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.606016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.606445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.740501 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.748309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6570b890-60d7-4390-a03a-9bd80c50d9dd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.156326 Jul 12 18:51:24.749113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 185/323] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:24 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:24.812731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:24.813347 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:24.819984 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.820438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.821206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:24.821646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:24.956067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:24.964350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e777e9f6-ec8a-416c-b06a-09c818d84ecd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1358 microversion: 2.1 time: 0.155595 Jul 12 18:51:24.964913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 139/324] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:24 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:25.152740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:25.153459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:25.159754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.160285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.161639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.162132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.313149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:25.324596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7bacc961-df7c-486f-8fca-51b8f215447b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.175928 Jul 12 18:51:25.325394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 186/325] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:25 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:25.610162 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:25.610770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:25.619115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.619709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.620488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.620930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.758493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:25.762327 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:25.766120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:25.766721 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:25.767241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:25.768840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:25.769988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a3aa2771-98e1-4d59-aabc-69911734afc9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.163824 Jul 12 18:51:25.770565 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 140/326] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:25 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:25.772836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.773284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.774044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.774474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.903141 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:25.910645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2e817b4a-ebb4-49cd-ac5f-5a7a6239603e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.148515 Jul 12 18:51:25.911792 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 187/327] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:25 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:25.981451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:25.982122 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:25.989552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.989552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:25.995735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:25.995735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.125393 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.133852 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7455ae38-feda-47a4-9e74-8ba120cebe28 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1548 microversion: 2.1 time: 0.156950 Jul 12 18:51:26.134808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 141/328] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:25 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:26.150382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.150996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:26.156958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.157524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.158162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.158600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.288501 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.296175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-09481266-0c90-4f22-a5f6-a4065bce6954 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1548 microversion: 2.1 time: 0.149860 Jul 12 18:51:26.296729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 188/329] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:26.312852 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.316424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.317746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Searching by: {'deleted': False, 'project_id': '173966e9a1ae48f88fd80f82c81f1079'} {{(pid=124970) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 12 18:51:26.324743 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.325163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.325940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.326366 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.341966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.342662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:26.349520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.349976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.350754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.351191 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.418387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.multi_cell_list [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 12 18:51:26.498441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.507295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-79aa2c94-ff19-4be7-9eee-a5a96cfbd981 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.169215 Jul 12 18:51:26.507894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 189/330] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:26.519684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-123d92a3-56f9-4399-80ea-4ffaf486386c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211208 Jul 12 18:51:26.520313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 142/331] 10.222.0.59 () {58 vars in 1124 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:26.530356 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.530900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:26.537544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.537993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.538755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.539191 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.668811 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.676242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d5b8a4fb-a184-4cf3-a301-2f5811ff0f19 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1548 microversion: 2.1 time: 0.149669 Jul 12 18:51:26.677947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 190/332] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:26.792606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.792606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:26.796482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.797009 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.797843 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.798347 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.930276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:26.931105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:26.934171 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.938307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.939022 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.940044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:26.940539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:26.943898 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.945432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:26.946770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ea92668e-1a99-4d6d-a1fb-6a04045b552c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.162003 Jul 12 18:51:26.947367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 143/333] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:27.091248 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:27.093835 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:27.100089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-521bcfe3-3a5b-47c7-b8c1-8b625cb09d80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.175405 Jul 12 18:51:27.100652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 191/334] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:26 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:27.524596 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:27.525264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:27.531328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:27.531782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:27.532547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:27.533006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:27.662835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:27.671518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-41a950b2-db18-4384-a6f9-729eef2150ef tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.150877 Jul 12 18:51:27.672122 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 144/335] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:27 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:27.965170 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:27.965775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:27.972494 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:27.972937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:27.974341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:27.974773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.103656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.111847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.113553 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.115562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-77f3d260-27b4-436a-bdbd-52efab09da10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.154313 Jul 12 18:51:28.116282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 192/336] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:27 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:28.117883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:28.118841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:28.125507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.126028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.126825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.127256 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.194610 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-585755792", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "networks": [{"uuid": "49cb6cc4-67d5-4173-81e1-c8021e43b5a8"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:28.247261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] validate_networks() for [('49cb6cc4-67d5-4173-81e1-c8021e43b5a8', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:51:28.281383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.290904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7f12440a-cb63-4ab5-bf9f-e38dbada53a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.177916 Jul 12 18:51:28.291698 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 145/337] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:28 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:28.642703 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:51:28.643164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:51:28.643662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:51:28.644062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:51:28.644495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:51:28.653939 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.654425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.655210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.655682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.673209 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Getting quotas for project ac5f763be1134225a570984c2bf62d3b. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:51:28.677445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Getting quotas for user a00e279ca0bb42ba935cb7b4fc75aa8d and project ac5f763be1134225a570984c2bf62d3b. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:51:28.688367 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:51:28.690352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:28.690630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:51:28.690972 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:28.697296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.697739 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.698730 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:28.699071 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:28.829404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.838189 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8fd3cb0b-6312-48bc-8944-acb5b1aeba08 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.152672 Jul 12 18:51:28.838753 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 146/338] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:28 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:28.851066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-383c5420-5b71-41f5-9d00-a1a9e36f4fe6 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660212 Jul 12 18:51:28.852141 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 193/339] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:51:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:51:28.864337 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f1a27408-2a71-42fc-b381-82f3ded93f5d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:28.865521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f1a27408-2a71-42fc-b381-82f3ded93f5d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:28.932653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f1a27408-2a71-42fc-b381-82f3ded93f5d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:28.939440 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f1a27408-2a71-42fc-b381-82f3ded93f5d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1218 microversion: 2.1 time: 0.081634 Jul 12 18:51:28.943471 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 147/340] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:28 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:29.021360 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-968e5e30-39ae-4c58-b0f9-9c4ba4bbd657 req-63bda047-85fc-4f4a-86da-8143ad391103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "name": "network-vif-plugged", "status": "completed", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:29.031745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-968e5e30-39ae-4c58-b0f9-9c4ba4bbd657 req-63bda047-85fc-4f4a-86da-8143ad391103 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.032123 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-968e5e30-39ae-4c58-b0f9-9c4ba4bbd657 req-63bda047-85fc-4f4a-86da-8143ad391103 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.042692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-968e5e30-39ae-4c58-b0f9-9c4ba4bbd657 req-63bda047-85fc-4f4a-86da-8143ad391103 service nova] Creating event network-vif-plugged:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:51:29.048044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-968e5e30-39ae-4c58-b0f9-9c4ba4bbd657 req-63bda047-85fc-4f4a-86da-8143ad391103 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030765 Jul 12 18:51:29.048632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 194/341] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:29.134590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:29.135216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:29.141967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.142422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.143188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.143650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.278520 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:29.286967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:29.288893 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:29.294283 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a6028693-e03d-4153-991b-6e07ba63325b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.159977 Jul 12 18:51:29.294283 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 148/342] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:29 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:29.308775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:29.309475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:29.316013 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.322774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.322774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.322774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.460232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:29.470189 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-47f06e51-13c7-43f8-ab35-d06f2a7f9d9b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.165646 Jul 12 18:51:29.471056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 195/343] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:29 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:29.541098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:29.542181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:29.548283 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.548734 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.549485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.549915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.855148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:29.855786 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:29.861991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.862438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:29.863228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:29.863693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.000340 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.010905 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7b976bfb-2e64-4929-b112-a5bea8b7d688 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.159503 Jul 12 18:51:30.011523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 196/344] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:29 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:30.016067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:30.016757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:30.022914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.023506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.024135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.024571 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.090520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.098383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-19e10126-d035-4c78-b8e7-6eee220b3915 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1222 microversion: 2.1 time: 0.085869 Jul 12 18:51:30.098988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 197/345] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:30 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:30.277901 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-987fe5e6-850e-42aa-966f-45d88b21c4db tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.740835 Jul 12 18:51:30.278489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 149/346] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:51:29 2022] POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:30.309089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:30.309697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:30.315552 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.315990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.316752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.317181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.443545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.451557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.453061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.454206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f8550955-0d21-48c0-be54-3bb409fcae88 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.149017 Jul 12 18:51:30.454762 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 198/347] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:30 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:30.488867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:30.489567 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:30.496622 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.497073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.497833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:30.498349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:30.633228 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:30.641174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3ab88487-db32-427f-bc09-2ae0ef4f33ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1522 microversion: 2.1 time: 0.156939 Jul 12 18:51:30.641727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 150/348] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:30 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:31.027881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:31.028484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:31.034671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.035368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.036316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.036903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.116382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:31.117186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:31.131081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.131081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.131081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.131081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.182562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.191134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0f4c6760-e662-4622-a262-557b186bf575 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.166969 Jul 12 18:51:31.194452 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 199/349] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:31 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:31.200117 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.208530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-036f7a81-be15-4dd1-a4e4-25578fe41ff4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1214 microversion: 2.1 time: 0.096985 Jul 12 18:51:31.211653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 151/350] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:31 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:31.472506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:31.473110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:31.479177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.479618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.480368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.480799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.612919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.621607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.623101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.624263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b47380c8-9f2f-46bf-b0a4-64201399690e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.155712 Jul 12 18:51:31.624817 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 200/351] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:31 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:31.658409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:31.658925 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:31.665008 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.665454 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.666261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.666694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.797002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.805680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-feac7dc0-69ba-47f5-ad86-84c14ba3b5e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1502 microversion: 2.1 time: 0.151323 Jul 12 18:51:31.806244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 152/352] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:31 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:31.825752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:31.826480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:31.832749 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.833192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.833984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:31.834421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:31.964744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:31.972488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-00bb1736-f15b-40e8-ab3b-911e3e6bc93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1515 microversion: 2.1 time: 0.150519 Jul 12 18:51:31.973126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 201/353] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:31 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:32.210999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:32.212012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:32.219273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.219783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.222267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.222716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.226956 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:32.227688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:32.234255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.234981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.236267 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.236866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.514503 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:32.522942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-080b4a22-0392-43da-88a2-22e487c8be87 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1288 microversion: 2.1 time: 0.300086 Jul 12 18:51:32.523692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 202/354] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:32 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1288 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:32.593422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:32.601878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-404827d0-7f8d-4432-b287-01c0c7df4815 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.395652 Jul 12 18:51:32.602839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 153/355] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:32 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:32.643838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:32.644440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:32.650561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.651002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.651771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:32.652198 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:32.790782 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:32.798575 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:32.800096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:32.801239 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b3732152-0a69-4433-8f2e-2044b6dfae42 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1744 microversion: 2.20 time: 0.161272 Jul 12 18:51:32.801784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 203/356] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:32 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:33.542233 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:33.543490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:33.553191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.553686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.554458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.554889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.619945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:33.620472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:33.626636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.627172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.629035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.629549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.633883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:33.643543 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e4393802-d059-4c77-bb11-c8322e96b67e tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1276 microversion: 2.1 time: 0.106866 Jul 12 18:51:33.650296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 154/357] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:33 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:33.821466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:33.822646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:33.828241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:33.829898 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.830350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.831122 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:33.831581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:33.840435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dc0a7ed0-33b0-4222-b737-f929bea5a47d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.225114 Jul 12 18:51:33.844662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 204/358] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:33 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:34.009916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:34.019649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:34.022363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:34.023347 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ff955c5f-b932-46a6-a40c-51c4768dcf35 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.206793 Jul 12 18:51:34.024121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 155/359] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:33 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:34.663659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:34.665309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:34.672739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:34.673208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:34.674136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:34.675037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:34.877482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:34.877482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b361d71c-3a4d-42a3-a15d-5a76d07d6fcd tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.198856 Jul 12 18:51:34.877482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 205/360] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:34 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:34.877839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:34.877839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:34.877839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:34.877839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:34.878810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:34.878810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.044477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:35.045483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:35.054003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.054704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.055853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.056611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.182429 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:35.190913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:35.194913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-14763748-e4c0-4c2f-a028-31d2fe2cd28e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.340228 Jul 12 18:51:35.201135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 156/361] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:34 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:35.299951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:35.314509 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:35.316089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:35.317258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bf1a3666-3c01-42d1-b72e-397329a7b861 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.278923 Jul 12 18:51:35.332962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 206/362] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:35 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:35.441780 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-a8c36c33-95cc-4a6a-8edb-2faded0c9107 req-c4facc78-a354-400e-8052-235a542bc2fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d97c3762-a4f5-4d97-bd81-3ffd30a0b147", "tag": "1828b832-4631-47ed-824c-2a2b6ee2dc31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:35.452289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-a8c36c33-95cc-4a6a-8edb-2faded0c9107 req-c4facc78-a354-400e-8052-235a542bc2fb service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.453198 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-a8c36c33-95cc-4a6a-8edb-2faded0c9107 req-c4facc78-a354-400e-8052-235a542bc2fb service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.465611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-a8c36c33-95cc-4a6a-8edb-2faded0c9107 req-c4facc78-a354-400e-8052-235a542bc2fb service nova] Creating event network-changed:1828b832-4631-47ed-824c-2a2b6ee2dc31 for instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 on hv-cinder-83538 Jul 12 18:51:35.471557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-a8c36c33-95cc-4a6a-8edb-2faded0c9107 req-c4facc78-a354-400e-8052-235a542bc2fb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 Jul 12 18:51:35.476867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 157/363] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:35.619996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:35.621427 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:35.631748 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.632349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.635815 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.636339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.663335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'flavor' on Instance uuid 99e2ae99-c398-460c-a71b-c02a1e76c13e {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:51:35.894857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:35.901410 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:35.908205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.911918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.914744 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:35.915255 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:35.955121 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:36.075231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e14a3dc7-25b4-4e3e-be01-36fab0680ab2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/action" status: 200 len: 32 microversion: 2.1 time: 0.455328 Jul 12 18:51:36.075231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 207/364] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:51:35 2022] POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/action => generated 32 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:51:36.086378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:36.087274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:36.099260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.104137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.104137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.104137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.281263 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.299208 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-46cb8f16-7675-4c8f-8e7f-4e8f936afb9c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.408799 Jul 12 18:51:36.310438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 158/365] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:35 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:36.316081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:36.316920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:36.324380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.325061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.325988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.326575 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.365013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:36.446117 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.456453 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f4ae901b-babe-4aed-a97a-9377058e7cee tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.379095 Jul 12 18:51:36.470830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 208/366] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:36 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:36.477140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:36.479747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:36.486639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.487499 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.488821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:36.489499 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:36.738099 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.749465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-03e5e9c1-e3e2-49ab-84ed-5dbfe5690c7c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.437157 Jul 12 18:51:36.751764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 159/367] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:36 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:36.800238 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.808691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.810236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:36.811430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fab5d33a-429c-475b-8e6b-056f8010a20d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.341894 Jul 12 18:51:36.822733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 209/368] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:36 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:37.318329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:37.319239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:37.326676 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.327118 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.327918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.328348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.478308 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:37.484374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:37.485099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:37.486377 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9f95eee7-986d-4c3d-baaa-6f52fe7a52b2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.172744 Jul 12 18:51:37.486955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 160/369] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:37 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:37.487166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:37.492129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.492702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.493382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.493836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.625463 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:37.633177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e369506e-14d5-44a6-a972-916010e905d3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.153394 Jul 12 18:51:37.633744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 210/370] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:37 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:37.779534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:37.780296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:37.786501 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.787242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.788161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.788669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.830169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:37.830826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:37.848679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.849802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:37.850782 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:37.851424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:38.039727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.049721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.050441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.052388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.056156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-76f75c81-24cc-452f-b310-40dab1cb6db1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.230153 Jul 12 18:51:38.064765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5a1b6400-ef5a-4036-b41f-c6aff4df8c41 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.291726 Jul 12 18:51:38.070385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 211/371] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:37 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:38.077115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 161/372] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:37 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:38.504600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:38.505329 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:38.512670 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:38.513204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:38.514062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:38.514561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:38.652783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:38.652783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:38.661730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:38.666146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:38.666610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:38.667419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:38.667860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:38.676488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.684695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:38.691339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bad891ab-35df-4dfe-9d1a-12fd9612122c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.191066 Jul 12 18:51:38.694332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 212/373] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:38 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:38.846096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:38.855433 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ca463d3a-e9fc-4387-9416-3996d99c58e2 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.209222 Jul 12 18:51:38.865089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 162/374] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:38 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:39.081692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:39.082829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:39.083888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:39.086853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:39.087133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:39.096881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.099267 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.105589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.105589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.106797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.107527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.108468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.109053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.318316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:39.322021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:39.329861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4a6d2332-3953-4fb4-a434-9a42a40c5ceb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.252024 Jul 12 18:51:39.342234 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 163/375] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:39 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:39.342525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:39.342525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:39.342525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-98cdecab-cf5a-4ccc-a953-88b0f27ae87d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.260918 Jul 12 18:51:39.342920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 213/376] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:39 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:39.710212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:39.714756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:39.717637 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.718656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.720182 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.720789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.874169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:39.875173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:39.875743 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:39.891265 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.892011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.892803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:39.893590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:39.898265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-61eb2836-1e48-4215-92bb-f6e575ed32fa tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.192562 Jul 12 18:51:39.899002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 164/377] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:39 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:40.084396 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:40.092333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9c2c2b5b-c878-48e0-84dc-598ca1716f79 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.222452 Jul 12 18:51:40.094491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 214/378] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:39 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:40.351359 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:40.351937 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:40.355958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:40.356565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:40.367405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.367405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:40.367405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.367405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:40.367852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.367852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:40.368004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.368493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:40.577696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:40.587804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1b4cce45-dfed-4977-8bea-b371db42b105 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1724 microversion: 2.1 time: 0.241670 Jul 12 18:51:40.588663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 165/379] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:40 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:40.595607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:40.605564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:40.607083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:40.608355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4458c899-630d-4b89-be6f-a84fb1c76f46 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.257528 Jul 12 18:51:40.608915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 215/380] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:40 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:40.916012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:40.916633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:40.923324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.930569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:40.930569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:40.930569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.097473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.106527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0b70ca75-f301-4fe1-8094-9bc223f9d54f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.195156 Jul 12 18:51:41.107554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 166/381] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:40 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:41.111861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:41.113747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:41.128475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.131739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.136706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.140643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.353090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.361234 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d66dc935-4acb-4e1e-8b36-d78d494bf17d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.253477 Jul 12 18:51:41.364044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 216/382] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:41 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:41.612193 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:41.613176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:41.615144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=85 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:41.621075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.622542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.623986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.624490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.628253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:41.629370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:41.637207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.638713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.639779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.640485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.914147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.930178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f6d249f9-4429-4df4-9251-e3b038764816 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1701 microversion: 2.1 time: 0.322340 Jul 12 18:51:41.942167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 167/383] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:41 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1701 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:41.943097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.950390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-674c1d40-bc53-47a2-a159-a5f65c510392 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:41.955080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.956018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-674c1d40-bc53-47a2-a159-a5f65c510392 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:41.957044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:41.957273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-674c1d40-bc53-47a2-a159-a5f65c510392 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:41.958828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9e3295c1-83cb-4eb4-95c5-05dde52702ae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.335052 Jul 12 18:51:41.961162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 217/384] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:41 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:41.994998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-674c1d40-bc53-47a2-a159-a5f65c510392 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Going to try to start instance {{(pid=124970) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 18:51:42.124519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:42.125131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:42.137479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.138281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.139316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.139985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.216314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-674c1d40-bc53-47a2-a159-a5f65c510392 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action" status: 202 len: 0 microversion: 2.1 time: 0.272604 Jul 12 18:51:42.217295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 168/385] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:51:41 2022] POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:51:42.229028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:42.229161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:42.244709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.246828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.246828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.246828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.369575 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:42.380100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-838e9467-9bf0-46cc-a1d0-a9abb1b08b43 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.259464 Jul 12 18:51:42.393046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 218/386] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:42 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:42.393046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:42.393046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:42.401021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.401469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.402315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.402753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.560746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:42.571850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ccbcfce4-4289-43f4-b845-0f1c11330fb3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1710 microversion: 2.1 time: 0.347627 Jul 12 18:51:42.573112 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 169/387] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:42 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1710 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:42.577611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:42.578382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:42.588819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.613048 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.613345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:42.613455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.613455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.613647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-34ce77b2-7880-41ce-8ded-207f4f4c0ecb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1594 microversion: 2.1 time: 0.224635 Jul 12 18:51:42.613647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 219/388] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:42 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1594 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:42.842029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:42.855033 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e439ff48-c5da-4173-97d6-a304413ab5b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.281325 Jul 12 18:51:42.855537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 170/389] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:42 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:42.978348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:42.978957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:42.985266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.985710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:42.986484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:42.986914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.285943 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:43.304392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:43.307836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:43.311504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0e8c03bc-280e-4aae-8f0f-9162ebcf5449 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.337408 Jul 12 18:51:43.315965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 220/390] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:42 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:43.390262 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-bd6cc66c-0974-4b59-9b13-f46d570ba694 req-27d23123-6c48-4941-aba4-103e74700521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97c3762-a4f5-4d97-bd81-3ffd30a0b147", "name": "network-vif-plugged", "status": "completed", "tag": "1828b832-4631-47ed-824c-2a2b6ee2dc31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:43.402330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:43.403362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:43.407908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-bd6cc66c-0974-4b59-9b13-f46d570ba694 req-27d23123-6c48-4941-aba4-103e74700521 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.409170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-bd6cc66c-0974-4b59-9b13-f46d570ba694 req-27d23123-6c48-4941-aba4-103e74700521 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.411492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.412808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.414661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.415331 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.435372 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-bd6cc66c-0974-4b59-9b13-f46d570ba694 req-27d23123-6c48-4941-aba4-103e74700521 service nova] Creating event network-vif-plugged:1828b832-4631-47ed-824c-2a2b6ee2dc31 for instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 on hv-cinder-83538 Jul 12 18:51:43.442817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-bd6cc66c-0974-4b59-9b13-f46d570ba694 req-27d23123-6c48-4941-aba4-103e74700521 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056765 Jul 12 18:51:43.444997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 171/391] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:43.591505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:43.592852 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:43.606844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.607803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.609178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.609861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.692590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:43.706076 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-165348b3-30ae-42c2-93fe-83daf9359b75 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.308214 Jul 12 18:51:43.707050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 221/392] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:43 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:43.872322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:43.873488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:43.885881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.888731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:43.891316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:43.893918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:44.190386 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.210941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9fb66e93-c615-4c3b-b795-b129df300cc5 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1710 microversion: 2.1 time: 0.619308 Jul 12 18:51:44.210941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 172/393] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:43 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1710 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:44.327635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.340350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:44.340969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:44.346183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5fa4a5fd-5f89-4eda-aa52-7f9556bda161 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.478264 Jul 12 18:51:44.346972 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 222/394] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:43 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:44.348496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:44.348954 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:44.349886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:44.351014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:44.589565 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.593098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:44.597992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.599508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.604050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bb48e100-e68f-44be-b542-344ca8139648 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.267849 Jul 12 18:51:44.604808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 173/395] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:44 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:44.724415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:44.725450 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:44.731502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:44.731952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:44.732710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:44.733146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:44.869113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:44.876421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-458333b2-5179-4980-878f-90af1ea78829 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.155939 Jul 12 18:51:44.876979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 223/396] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:44 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:45.223846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:45.224459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:45.236181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.236636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.237444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.240140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.363871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:45.365060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:45.371941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.372592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.376438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.377071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.396495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:45.570179 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:45.579269 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2e1bde0c-0a4b-407c-bbcc-39b6dc9199c1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1714 microversion: 2.1 time: 0.359215 Jul 12 18:51:45.579901 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 174/397] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:45 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1714 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:45.637924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:45.637924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:45.637924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.637924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.638945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.638945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.662018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:45.670649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-89779a1e-7ed6-4ac5-9fbf-f0b3ebd55b2b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.310629 Jul 12 18:51:45.671222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 224/398] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:45 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:45.868867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:45.876686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:45.878195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:45.879623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7b9d09d0-a2d2-4fcf-bdef-ea0619065e1d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.261316 Jul 12 18:51:45.880190 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 175/399] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:45 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:51:45.894361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:45.894904 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:45.902036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.902480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:45.903242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:45.903710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:46.052737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:46.060599 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b528e211-ecf5-421d-928a-f9b697935ae4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1318 microversion: 2.1 time: 0.170093 Jul 12 18:51:46.061574 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 225/400] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:45 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:46.089793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-1dd85075-f47c-4d76-949f-954dfff5fe48 req-27b4fb97-a6c3-4f90-b069-e9b376d495d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:46.097995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1dd85075-f47c-4d76-949f-954dfff5fe48 req-27b4fb97-a6c3-4f90-b069-e9b376d495d5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:46.098422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1dd85075-f47c-4d76-949f-954dfff5fe48 req-27b4fb97-a6c3-4f90-b069-e9b376d495d5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:46.111463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-1dd85075-f47c-4d76-949f-954dfff5fe48 req-27b4fb97-a6c3-4f90-b069-e9b376d495d5 service nova] Creating event network-changed:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:51:46.117005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-1dd85075-f47c-4d76-949f-954dfff5fe48 req-27b4fb97-a6c3-4f90-b069-e9b376d495d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031026 Jul 12 18:51:46.118985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 176/401] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:51:46.689154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:46.689777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:46.697102 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:46.697650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:46.698472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:46.699377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:46.857183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:46.865358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-62839478-1023-4f72-9c8b-7362fdc91de7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.180008 Jul 12 18:51:46.867927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 226/402] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:46 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:46.899040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:46.899770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:46.906820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:46.907282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:46.908047 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:46.908473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:47.058803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:47.067157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:47.069996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:47.071288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8640dfdc-1cb7-44eb-99d3-baa796622621 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1739 microversion: 2.20 time: 0.177189 Jul 12 18:51:47.072891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 177/403] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:46 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:47.078128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:47.078823 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:47.086693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:47.087438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:47.088241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:47.088853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:47.240999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:47.249489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-65c50508-c1b6-4ba7-92b7-9b4ca162d9ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1507 microversion: 2.1 time: 0.175278 Jul 12 18:51:47.250162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 227/404] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:47 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:47.890432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:47.891044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:47.898334 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:47.899080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:47.900668 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:47.901302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:48.102193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:48.102193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:48.104210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:48.104809 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:48.105923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:48.106422 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:48.131475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:48.139723 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-200af6f4-5eaf-4545-a77c-37790959a1c8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.253455 Jul 12 18:51:48.140887 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 178/405] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:47 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:48.343424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:48.352591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:48.354586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:48.355954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8fe757a0-6064-4389-9ab8-cf870a87f077 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1721 microversion: 2.20 time: 0.268631 Jul 12 18:51:48.364404 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 228/406] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:48 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:49.080348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-611113077"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:49.080909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:49.088410 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.088861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.089798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.090261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.157656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:49.158322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:49.165394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.165854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.166690 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.167139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.270492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.network.security_group_api [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Adding security group c8f09959-9492-4923-b884-b857da6d5806 to port 7f28e2f1-1a45-4459-ba5e-970f577313a1 Jul 12 18:51:49.402592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:49.410584 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5cefb1bf-3c94-4148-b094-88632a5cb268 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.256647 Jul 12 18:51:49.411412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 229/407] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:49 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:49.418212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-5d912833-5ae9-4ded-a1c2-0c2fbc19b8ad req-b0067d89-45e6-4cfb-8180-2126c7ce1c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "name": "network-vif-unplugged", "status": "completed", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:49.427839 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-5d912833-5ae9-4ded-a1c2-0c2fbc19b8ad req-b0067d89-45e6-4cfb-8180-2126c7ce1c7a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.428280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-5d912833-5ae9-4ded-a1c2-0c2fbc19b8ad req-b0067d89-45e6-4cfb-8180-2126c7ce1c7a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.440786 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-5d912833-5ae9-4ded-a1c2-0c2fbc19b8ad req-b0067d89-45e6-4cfb-8180-2126c7ce1c7a service nova] Creating event network-vif-unplugged:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:51:49.446924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-5d912833-5ae9-4ded-a1c2-0c2fbc19b8ad req-b0067d89-45e6-4cfb-8180-2126c7ce1c7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033865 Jul 12 18:51:49.447550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 230/408] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:49.452510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:49.453206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:49.459269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.459752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.460512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.460992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.677681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:49.685815 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:49.687364 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:49.688517 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5aab5d99-ed8f-4e17-9b1a-50b0e1d6d8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1721 microversion: 2.20 time: 0.239908 Jul 12 18:51:49.689070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 231/409] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:49 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:49.849470 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e19f00d0-574e-4a00-bee9-33ec0f566fda tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.773404 Jul 12 18:51:49.853732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 179/410] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:51:49 2022] POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:51:49.858411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-dc60a446-ac12-4b01-8b92-8e6236876a65 req-3fce1183-654b-4015-aef3-a8d9da4838b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:49.858559 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:49.859126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:49.869866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-dc60a446-ac12-4b01-8b92-8e6236876a65 req-3fce1183-654b-4015-aef3-a8d9da4838b8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.870319 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-dc60a446-ac12-4b01-8b92-8e6236876a65 req-3fce1183-654b-4015-aef3-a8d9da4838b8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.875802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.876912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.877713 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:49.878328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:49.907917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-dc60a446-ac12-4b01-8b92-8e6236876a65 req-3fce1183-654b-4015-aef3-a8d9da4838b8 service nova] Creating event network-changed:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:51:49.921807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-dc60a446-ac12-4b01-8b92-8e6236876a65 req-3fce1183-654b-4015-aef3-a8d9da4838b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062178 Jul 12 18:51:49.923107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 232/411] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:51:50.067195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:50.076380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3dee20de-af54-4c69-9500-41b5f88e3cc3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1759 microversion: 2.1 time: 0.221512 Jul 12 18:51:50.076967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 180/412] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:49 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1759 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:50.428748 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:50.429625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:50.437923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:50.438472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:50.439714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:50.440222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:50.581233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:50.589988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cc57b166-5469-4823-8a7f-f2bcd180e70d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.165735 Jul 12 18:51:50.590562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 233/413] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:50 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:50.709111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:50.712039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:50.725125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:50.725738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:50.726811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:50.727583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:51.123080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:51.132291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:51.135962 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:51.137663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8e966ab6-9858-4c8d-b2a3-c5b6aae9eebb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1721 microversion: 2.20 time: 0.433704 Jul 12 18:51:51.138431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 181/414] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:50 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:51.607863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:51.608478 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:51.614637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:51.615197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:51.615996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:51.616429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:51.749012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:51.757016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fc6ed071-c4e0-44c7-8f54-dcd35eac9cf6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.153190 Jul 12 18:51:51.757584 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 234/415] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:51 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:51:52.157058 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:52.157663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:52.164333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.164780 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.165612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.166048 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.347109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:52.355479 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:52.356991 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:52.358136 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c63f8283-279f-472b-a99f-17a10c749c0b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1664 microversion: 2.20 time: 0.205052 Jul 12 18:51:52.358696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 182/416] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:52 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1664 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:52.376427 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b8d3c91-32ec-41b9-950b-3f96068053f6"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:52.377431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:52.384346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.384887 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.385653 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.386087 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.773671 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:52.774407 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:52.781101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.781542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.782316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:52.782745 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:52.923694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:52.932398 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6776b6f5-1f6e-46de-ac8a-c450c11adc3a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.162483 Jul 12 18:51:52.933125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 183/417] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:52 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:53.375705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-561bd975-ee16-4cb5-8655-55ce1611506d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.003231 Jul 12 18:51:53.376343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 235/418] 10.222.0.59 () {62 vars in 1363 bytes} [Tue Jul 12 18:51:52 2022] POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments => generated 188 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:51:53.492525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:51:53.493351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:53.500212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.504030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.505470 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.505920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.825945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f79503d5-2218-47fe-812f-284800c5ab6a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/action" status: 202 len: 0 microversion: 2.20 time: 0.337346 Jul 12 18:51:53.830168 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 184/419] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Jul 12 18:51:53 2022] POST /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:51:53.834984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:53.835632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:53.844449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.845155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.846092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.846698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.949811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:53.950528 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:53.956938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.957756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.958540 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:53.958983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:53.995892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:54.005403 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:54.007371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:54.008646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-837c25a2-5dc3-4ada-8bf8-278372d76e14 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1750 microversion: 2.20 time: 0.177510 Jul 12 18:51:54.009366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 236/420] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:53 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:54.099400 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:54.107922 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-adee0940-577a-4456-963c-6a447b9d4072 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.162301 Jul 12 18:51:54.108492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 185/421] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:53 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:55.027971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:55.028611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:55.034692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:55.035161 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:55.035955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:55.036392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:55.125395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:55.126027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:55.133380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:55.134653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:55.135650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:55.136097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:55.187805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:55.199692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:55.201514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:55.203326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eb6bccb4-3487-485f-a35a-49c1e5f2f4f8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1750 microversion: 2.20 time: 0.179349 Jul 12 18:51:55.203892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 237/422] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:55 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:55.288108 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:55.296264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3686fcdc-244b-4af8-bb36-05cf9506c92b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.175053 Jul 12 18:51:55.296844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 186/423] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:55 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:56.222210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:56.222819 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:56.229892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:56.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:56.231107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:56.231573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:56.313832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:56.314436 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:56.321427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:56.321885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:56.322692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:56.323124 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:56.377124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:56.386521 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:56.388070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:56.390806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e2c50d61-1af9-4077-bd2f-ecf1e7e980ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1752 microversion: 2.20 time: 0.171158 Jul 12 18:51:56.390806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 238/424] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:56 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:56.466392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:56.475405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7c1d133b-171f-4371-8f87-3e79c331e61d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.164064 Jul 12 18:51:56.475405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 187/425] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:56 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:57.408013 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:57.408632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:57.414477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:57.414931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:57.415709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:57.416134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:57.490757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:57.491409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:57.498045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:57.498489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:57.499246 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:57.499695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:57.587047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:57.589437 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:51:57.597223 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:57.602349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:57.602349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-63c8e522-5231-43cc-b557-c1977d724187 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1752 microversion: 2.20 time: 0.195958 Jul 12 18:51:57.602349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 239/426] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:57 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1752 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:57.655924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:57.664053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0ff96d37-5de8-45c1-98f1-30589f597c17 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.177010 Jul 12 18:51:57.664616 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 188/427] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:57 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:58.617796 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:58.618822 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:58.627759 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:58.628199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:58.628963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:58.632825 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:58.681051 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:58.683114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:58.690811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:58.691549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:58.692638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:58.693300 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:58.808609 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:58.817669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:58.819232 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:58.820481 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-715c4acf-5654-406e-afc9-f612884b7895 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1752 microversion: 2.20 time: 0.206561 Jul 12 18:51:58.821046 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 240/428] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:58 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1752 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:51:58.851972 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:51:58.859973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-862caedb-9a24-45cd-9117-0447fa91d9de tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.183016 Jul 12 18:51:58.860557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 189/429] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:58 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:51:59.838621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:59.839256 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:59.845852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:59.846492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:59.847389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:59.847827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:59.877956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:51:59.878557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:51:59.885490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:59.885935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:59.886695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:51:59.887387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:51:59.911098 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:00.046019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:00.054680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:00.056280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:00.057535 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bae10c96-f893-4664-8a97-f87162357b21 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.223297 Jul 12 18:52:00.058108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 241/430] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:51:59 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:00.072840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:00.080275 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d106980b-108e-4fbf-92fb-6740a7e3eb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.206223 Jul 12 18:52:00.081066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 190/431] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:51:59 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:01.075454 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:01.076056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:01.082029 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.082469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.083228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.084282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.098147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:01.098759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:01.107282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.108353 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.109140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.109579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.297405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:01.301697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:01.307087 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:01.308962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:01.309426 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7e705969-c879-407d-ad70-4a1e3078d62f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1501 microversion: 2.1 time: 0.215441 Jul 12 18:52:01.310043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 191/432] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:01 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1501 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:01.310480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b198e0f2-2177-4430-86f3-131b903084fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.239128 Jul 12 18:52:01.311134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 242/433] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:01 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:01.326382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca248fda-9294-47bd-8118-4f76c8082491"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:01.327544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:01.333537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.333988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.334757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.335199 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.360840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] HTTP exception thrown: Cannot 'attach_volume' instance 99e2ae99-c398-460c-a71b-c02a1e76c13e while it is in vm_state rescued Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Request method failure captured: Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/os-volume_attachments HTTP/1.1 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 74 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcJmcmVtXABsamAjtF1ISXeDG2KdSyduJ1o4ZF-tgxw6vBX6aKS0Kj3uhpoAmzqeaGJYUNHwdbXNveA-rMN8BCQeDzyQhgCbg3BLWAk14wyK9fc3hyNvxj2wAi-DAYto84xToWz0NHPfjhOT2A0HrjxkSLvJwz1T2nNMorPMUP2wnY0 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:52:01.362524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eb4f266e82834cc7930a4e60343660c9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 56363156a2b046fca40df895b3f6a050 Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {"volumeAttachment": {"volumeId": "ca248fda-9294-47bd-8118-4f76c8082491"}} Jul 12 18:52:01.364164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Cannot 'attach_volume' instance 99e2ae99-c398-460c-a71b-c02a1e76c13e while it is in vm_state rescued Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'server_id': '99e2ae99-c398-460c-a71b-c02a1e76c13e', 'body': {'volumeAttachment': {'volumeId': 'ca248fda-9294-47bd-8118-4f76c8082491'}}} Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:52:01.365093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 99e2ae99-c398-460c-a71b-c02a1e76c13e while it is in vm_state rescued Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:52:01.366493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 99e2ae99-c398-460c-a71b-c02a1e76c13e while it is in vm_state rescued Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Returning 409 to user: Cannot 'attach_volume' instance 99e2ae99-c398-460c-a71b-c02a1e76c13e while it is in vm_state rescued {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dd8ff805-6d03-48c0-a47f-b77c37f122a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042001 Jul 12 18:52:01.367924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 192/434] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:52:01 2022] POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:52:01.375044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:01.375615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:01.381963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.382425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.383195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.383654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.597686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-74ee2a39-01ac-4420-be43-1c39ebce5744 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/action" status: 202 len: 0 microversion: 2.1 time: 0.226295 Jul 12 18:52:01.598410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 243/435] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:52:01 2022] POST /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:52:01.608557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:01.609158 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:01.617115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.617746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.618514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:01.619013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:01.767627 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:01.774630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d647cc6e-fe41-4827-8428-c578c1d768bc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.171873 Jul 12 18:52:01.783934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 193/436] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:01 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:02.330843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:02.332435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:02.341307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:02.349435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:02.350616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:02.351348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:02.517832 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:02.527117 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:02.528689 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:02.530042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a8630047-98d3-4f9c-8e17-a6634f5c8203 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.204239 Jul 12 18:52:02.530633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 244/437] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:02 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:02.805696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:02.805696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:02.809376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:02.809893 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:02.810674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:02.811110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:02.954192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:02.962265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e8112f13-0f39-45f2-95ab-30c135ee0b1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.165869 Jul 12 18:52:02.963381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 194/438] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:02 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:03.548534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:03.549188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:03.555175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:03.555649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:03.556946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:03.557632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:03.690465 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:03.699512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:03.701038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:03.702167 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-acfe5824-373d-4132-be98-878cb265eef7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.157752 Jul 12 18:52:03.702720 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 245/439] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:03 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:03.980850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:03.981505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:03.988279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:03.988802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:03.989692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:03.990119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:04.118341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:04.126288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-84e04ec0-af71-479f-896d-a26ef5257761 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.150053 Jul 12 18:52:04.126849 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 195/440] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:03 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:04.721306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:04.721903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:04.727930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:04.728373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:04.729211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:04.729639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:04.862143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:04.870511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:04.872049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:04.873194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-92c9836c-f84d-4c29-8432-b1df4ef1adb5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.155770 Jul 12 18:52:04.873753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 246/441] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:04 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:05.143815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:05.144434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:05.150768 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:05.151212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:05.152013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:05.152508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:05.281623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:05.289348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-50eb94b3-7ae3-494e-86e3-674185654bad tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.149541 Jul 12 18:52:05.289918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 196/442] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:05 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:05.891945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:05.892551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:05.898583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:05.899031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:05.899817 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:05.900252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:06.047775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:06.056382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:06.057897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:06.059051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-390e4543-eeb7-4310-8333-6879e4a13c68 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.171608 Jul 12 18:52:06.060093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 247/443] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:05 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:06.306100 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:06.306793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:06.313709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:06.314107 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:06.314866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:06.315332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:06.451023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:06.459751 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-49184f77-5b99-4b65-bd41-6bc4737c0642 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.157586 Jul 12 18:52:06.460531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 197/444] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:06 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:07.077580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:07.078188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:07.084163 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:07.084608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:07.085361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:07.085794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:07.227471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:07.236540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:07.238038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:07.239184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-96cece57-03ce-4cb8-9183-80db909fcac0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.165745 Jul 12 18:52:07.239784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 248/445] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:07 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:07.477523 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:07.478081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:07.485708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:07.486417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:07.487737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:07.488176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:07.621468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:07.629370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4734f969-038b-4de4-912d-ee5aca2b4f5d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.155879 Jul 12 18:52:07.630186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 198/446] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:07 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:08.260603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:08.261539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:08.264831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=78 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:08.270002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:08.270455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:08.271253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:08.271717 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:08.403967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:08.412303 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:08.413814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:08.414958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1cda56ef-79ab-4a6d-9b12-ca40439da403 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.160472 Jul 12 18:52:08.415636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 249/447] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:08 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:08.648184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:08.649552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:08.657584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:08.658087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:08.658860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:08.659293 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:08.796417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:08.806564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d65c9de6-d7fc-4d27-be3d-33f8b535ebcd tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.162193 Jul 12 18:52:08.807159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 199/448] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:08 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:09.434278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:09.435619 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:09.441678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:09.442122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:09.442900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:09.443368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:09.576486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:09.597802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:09.601307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:09.601307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8909b2ba-94d2-4b16-9331-b0aaface019f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.170200 Jul 12 18:52:09.601307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 250/449] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:09 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:09.824250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:09.825348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:09.831874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:09.832326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:09.833099 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:09.833537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:09.980030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:09.990782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cb2a5dda-d110-4acf-b2ce-69eef5b2fce6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.170263 Jul 12 18:52:09.991593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 200/450] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:09 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:10.619669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:10.620285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:10.627731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:10.628174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:10.628940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:10.629366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:10.774916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:10.785314 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:10.786808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:10.787998 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b244098c-14d4-4e90-8042-c94c5375bbde tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.172465 Jul 12 18:52:10.788550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 251/451] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:10 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:11.009621 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:11.011057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:11.019745 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:11.020572 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:11.021557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:11.022312 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:11.156602 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:11.165125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-09f5b9a4-cff0-40d2-9e2f-53675859f206 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.160447 Jul 12 18:52:11.176129 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 201/452] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:11 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:11.805949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:11.806548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:11.812746 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:11.813190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:11.813969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:11.814355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:11.945294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:11.954689 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:11.956637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:11.957914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1b180b02-45e3-42a8-a6b9-3e88c2ce7847 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.155978 Jul 12 18:52:11.968896 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 252/453] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:11 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:12.185874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:12.186442 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:12.188804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=72 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:12.193754 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:12.194200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:12.194960 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:12.195495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:12.346194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:12.354514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-30eb7302-30b9-4a28-a3b7-b270e92e3538 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.172609 Jul 12 18:52:12.355092 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 202/454] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:12 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:12.978574 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:12.981738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:12.988995 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:12.989722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:12.990733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:12.991171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:13.131623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:13.140153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:13.141694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:13.142835 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b5d540b5-4754-4cea-8a4c-3f63e4bf9acc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.168573 Jul 12 18:52:13.143420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 253/455] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:12 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:13.369765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb11cc04-4f5e-47f1-84a6-9e81bc9b0f43", "device": "/dev/sdb"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:13.371390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:13.373889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:13.374717 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:13.381317 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:13.384560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:13.385227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:13.386124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:13.386684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:13.386973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:13.387722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:13.388221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:13.545958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:13.553589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-471b358d-2750-4983-934b-95a7a1a75df3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.185573 Jul 12 18:52:13.560978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 254/456] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:13 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:14.161463 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:14.162128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:14.170369 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:14.170806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:14.172206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:14.172766 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:14.188033 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:14.303488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:14.312697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:14.314214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:14.315392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bfc4e799-6141-46ad-9804-6dfc869b646a tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.158113 Jul 12 18:52:14.315960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 255/457] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:14 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:14.571120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:14.571756 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:14.577868 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:14.578317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:14.579083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:14.579549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:14.712131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:14.720352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-04dbfc46-3206-4549-baae-33b24e9d5b3f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.153166 Jul 12 18:52:14.720916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 256/458] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:14 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:15.335019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:15.336012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:15.344560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:15.345014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:15.345796 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:15.346231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:15.481992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:15.491031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:15.492579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:15.493718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9c13e982-121f-4601-ba4c-c688b63d56b3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.163556 Jul 12 18:52:15.494271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 257/459] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:15 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:15.738591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:15.739279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:15.746438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:15.746900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:15.747806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:15.748248 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:15.901016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:15.909611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4aefea56-3b8e-4271-bada-0bede8391dc1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.175384 Jul 12 18:52:15.910184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 258/460] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:15 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:16.511268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:16.511976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:16.518643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:16.519092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:16.519888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:16.520320 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:16.648066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:16.656493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:16.657919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:16.659066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0bb6e21f-b0c1-4ddf-b9ed-87b45af35bc3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.151732 Jul 12 18:52:16.659668 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 259/461] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:16 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:16.926847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:16.927559 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:16.933815 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:16.934262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:16.935018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:16.935501 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:17.066294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:17.073744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-769dfa0e-62cd-4568-a366-bc1cd768fadc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.150813 Jul 12 18:52:17.074306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 260/462] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:16 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:17.677347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:17.678009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:17.684133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:17.684586 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:17.685853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:17.686290 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:17.818223 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:17.827246 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:17.828787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:17.829940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7c9e585d-2714-4973-b5b5-b5b86a2e0d03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.156603 Jul 12 18:52:17.830502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 261/463] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:17 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:18.091382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:18.091993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:18.097920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:18.098358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:18.099099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:18.099551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:18.225716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:18.233605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ec2bc9bd-26dc-46a1-84f9-94b2c629e7ed tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.146075 Jul 12 18:52:18.234176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 262/464] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:18 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:18.848584 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:18.849240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:18.855282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:18.855755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:18.856515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:18.856948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:18.987144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:18.995567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:18.997086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:18.999403 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e3e9b7d8-8a60-4841-9d17-4e74211aa02c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.154232 Jul 12 18:52:18.999970 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 263/465] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:18 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:19.249952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:19.250565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:19.256799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:19.257247 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:19.258007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:19.258440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:19.392728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:19.394908 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7020fdd8-d0f3-4040-baef-a80e2a1b213e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.148801 Jul 12 18:52:19.395510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 264/466] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:19 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:20.018655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:20.019294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:20.025301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:20.025728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:20.026477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:20.026909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:20.154527 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:20.162800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:20.164327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:20.165507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1ee3d20e-9f94-40c7-9be6-bb8566e5cb10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.151463 Jul 12 18:52:20.166061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 265/467] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:20 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:20.412681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:20.413218 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:20.419347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:20.420332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:20.421323 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:20.421764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:20.552095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:20.559497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a7da54b1-8132-472f-a3c0-ec43940a70a0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.150611 Jul 12 18:52:20.560067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 266/468] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:20 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:21.183083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:21.183807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:21.189895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:21.190333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:21.191084 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:21.191546 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:21.321451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:21.330538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:21.332451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:21.333390 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-169d39f0-d088-4d2b-9a56-5b99b32d5bed tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.154315 Jul 12 18:52:21.333945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 267/469] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:21 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:21.578123 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:21.579625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:21.585625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:21.586078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:21.586836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:21.587274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:21.720052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:21.727657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9febe1ac-84c7-4d5e-a489-aba0736a2efb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.154404 Jul 12 18:52:21.728261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 268/470] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:21 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:22.353621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:22.354307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:22.360445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:22.360890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:22.361641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:22.362073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:22.495488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:22.505380 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:22.507270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:22.508705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4faf654e-0334-4f0f-a0bf-aa74ca4f13c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.159214 Jul 12 18:52:22.509409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 269/471] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:22 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:22.746210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:22.746885 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:22.754179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:22.754653 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:22.755731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:22.756220 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:22.908638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:22.916776 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-67c29433-4d3d-4c3c-a7fe-9126790e1540 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.174849 Jul 12 18:52:22.917455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 270/472] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:22 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:23.381700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:23.530495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:23.531037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:23.537061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:23.537507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:23.538272 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:23.538711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:23.671865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:23.680834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:23.684530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:23.684530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e472d755-7878-4a7a-aa4b-d243e21f3887 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.157746 Jul 12 18:52:23.684530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 271/473] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:23 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:23.739881 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fed3f310-024c-4e48-bcf6-386f75bc8931 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "POST /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.373766 Jul 12 18:52:23.740503 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 203/474] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:52:13 2022] POST /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147/os-volume_attachments => generated 194 bytes in 10375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:52:23.934014 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:23.934654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:23.941269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:23.941711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:23.942462 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:23.942893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:23.946706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:24.076158 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:24.080844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-30327e84-f1d7-456a-8693-73a21f18f88d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.150692 Jul 12 18:52:24.081429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 272/475] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:23 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:24.704684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:24.705379 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:24.711638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:24.712087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:24.712845 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:24.713284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:24.855414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:24.863754 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:24.865249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:24.866398 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-32709af9-3cbe-4ead-92ca-81c453f0363e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.166625 Jul 12 18:52:24.866957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 204/476] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:24 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:25.098024 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:25.099562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:25.104852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:25.105299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:25.106139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:25.106598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:25.234635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:25.242341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-acc1b0cb-fa03-436e-9ece-e88353ca48a4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.148237 Jul 12 18:52:25.243262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 273/477] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:25 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:25.885369 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:25.886145 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:25.893907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:25.894376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:25.895178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:25.895643 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:26.032933 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:26.041375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:26.042883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:26.044065 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d768d95a-7a09-4f93-846a-469389e31871 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.162971 Jul 12 18:52:26.044620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 205/478] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:25 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:26.260081 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:26.260691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:26.266918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:26.267399 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:26.268162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:26.268598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:26.399635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:26.407539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-98ed8667-da21-4e62-9aff-2878b73a235d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1509 microversion: 2.1 time: 0.151306 Jul 12 18:52:26.408101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 274/479] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:26 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:27.063155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:27.063784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:27.070222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:27.070665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:27.071449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:27.071879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:27.075880 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:27.199104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:27.207917 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:27.209368 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:27.210505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c29660d5-41e1-4b0f-b01c-55197b99be82 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.151409 Jul 12 18:52:27.211049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 206/480] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:27 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:27.424402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:27.425011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:27.431083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:27.431567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:27.432332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:27.432772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:27.561791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:27.569552 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3656ef10-4866-47b5-b2b3-00743f02283a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1515 microversion: 2.1 time: 0.149068 Jul 12 18:52:27.570124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 275/481] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:27 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:28.230056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:28.230660 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:28.237721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:28.238189 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:28.238942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:28.239396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:28.367081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:28.375675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:28.377186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:28.378334 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c5e6bde0-fbae-4315-a9ca-fc6010997924 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.152315 Jul 12 18:52:28.378951 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 207/482] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:28 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:29.396893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:29.397498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:29.403606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:29.404057 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:29.404850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:29.405428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:29.540388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:29.549601 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:29.551196 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:29.552388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f605b809-5f2d-4e16-a7f4-0acd1d029e1c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.159484 Jul 12 18:52:29.552962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 276/483] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:29 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:30.203861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c85ccb7d-8787-4298-9db3-7a9f093ea2eb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: .version_select at 0x7f01784451f0>, body: {"keypair": {"name": "tempest-keypair-1942721721", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZb+3GlnarzmfokUzZa0MHsm52mHoawxbI6PnQzOrC8fNi2gM7mZD9woxBjOdYMqLrP7yzO9aTXgINutXKNECOptpOgZudVDy9sNk5VXHB5cy59rcO/c/BlnNDhzpg2Ag=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:30.218849 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-c85ccb7d-8787-4298-9db3-7a9f093ea2eb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for project eb4f266e82834cc7930a4e60343660c9. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:52:30.222700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-c85ccb7d-8787-4298-9db3-7a9f093ea2eb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for user 56363156a2b046fca40df895b3f6a050 and project eb4f266e82834cc7930a4e60343660c9. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:52:30.325622 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c85ccb7d-8787-4298-9db3-7a9f093ea2eb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126141 Jul 12 18:52:30.326253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 208/484] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:52:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:52:30.574580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:30.574580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:30.578576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:30.579101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:30.579911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:30.580374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:30.710062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:30.718939 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:30.720495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:30.721656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3f272613-0ee4-4549-85a6-ca64853dc85d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.154643 Jul 12 18:52:30.722219 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 277/485] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:30 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:31.573095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-06299df8-6df3-4d1e-af35-ffafe2e8aa90 req-8d64502d-bd3e-46fa-9588-792fc257a546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "name": "network-vif-plugged", "status": "completed", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:31.584147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-06299df8-6df3-4d1e-af35-ffafe2e8aa90 req-8d64502d-bd3e-46fa-9588-792fc257a546 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:31.584683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-06299df8-6df3-4d1e-af35-ffafe2e8aa90 req-8d64502d-bd3e-46fa-9588-792fc257a546 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:31.596281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-06299df8-6df3-4d1e-af35-ffafe2e8aa90 req-8d64502d-bd3e-46fa-9588-792fc257a546 service nova] Creating event network-vif-plugged:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:52:31.601748 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-06299df8-6df3-4d1e-af35-ffafe2e8aa90 req-8d64502d-bd3e-46fa-9588-792fc257a546 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035005 Jul 12 18:52:31.602431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 209/486] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:52:31.740379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:31.741093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:31.747260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:31.747888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:31.748870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:31.749228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:31.890300 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:31.898848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:31.900365 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:31.901500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eef9d8a5-7b19-48dc-bbc8-3b91b2ca8361 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.165144 Jul 12 18:52:31.902185 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 278/487] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:31 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:32.469719 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-182743350", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25e3b490-65f8-4436-9faa-e84f2e3a2650"}], "security_groups": [{"name": "tempest-securitygroup--792525255"}], "key_name": "tempest-keypair-1942721721", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:32.568810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] validate_networks() for [('25e3b490-65f8-4436-9faa-e84f2e3a2650', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:52:32.921572 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:32.922263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:32.928482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:32.928941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:32.929879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:32.930154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:32.951220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:52:32.951778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:52:32.952139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:52:32.952609 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:52:32.953221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:52:32.962472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:32.964838 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:32.964838 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:32.964838 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:32.981856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:52:32.986794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Getting quotas for user 56363156a2b046fca40df895b3f6a050 and project eb4f266e82834cc7930a4e60343660c9. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:52:32.998395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:52:33.000990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:52:33.061471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:33.069838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:33.071379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:33.072530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3e3e7ab2-7458-4aa6-8cb4-60b1b097fd9c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.155633 Jul 12 18:52:33.073090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 279/488] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:32 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:33.120279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-93d0f522-bfdc-4fda-8514-a0c6bc2c2c6e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.656087 Jul 12 18:52:33.120925 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 210/489] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:52:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:52:33.131115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-de64153b-3333-4da3-8a74-c1513de293a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:33.131781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-de64153b-3333-4da3-8a74-c1513de293a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:33.188463 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-de64153b-3333-4da3-8a74-c1513de293a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:33.196459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-de64153b-3333-4da3-8a74-c1513de293a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1245 microversion: 2.1 time: 0.069354 Jul 12 18:52:33.197259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 280/490] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:33 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:34.092109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:34.093030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:34.099586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:34.100030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:34.100784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:34.101209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:34.214026 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:34.214619 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:34.221502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:34.221954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:34.222724 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:34.223159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:34.234402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:34.242947 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:34.244479 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:34.245625 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-72bae135-57ec-4e35-91aa-bf15b44e48f5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.158133 Jul 12 18:52:34.246196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 211/491] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:34 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:34.285090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:34.292376 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1006048a-99b6-45f7-8ac9-9bc624a4791f tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1249 microversion: 2.1 time: 0.082286 Jul 12 18:52:34.292944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 281/492] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:34 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:35.263915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:35.264575 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:35.271139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:35.271623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:35.272391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:35.272827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:35.309865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:35.310560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:35.317515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:35.318041 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:35.318903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:35.319436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:35.396001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:35.403204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e9c28634-9f50-4c00-b57e-b431e4a8050e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1297 microversion: 2.1 time: 0.097004 Jul 12 18:52:35.403803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 282/493] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:35 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:35.425027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:35.433414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:35.434932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:35.436747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6f77221f-2432-4224-bdf4-89f5d243fb13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.176127 Jul 12 18:52:35.437477 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 212/494] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:35 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:36.420493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:36.421638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:36.427332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:36.431164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:36.431164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:36.431164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:36.456548 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:36.457343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:36.464253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:36.465195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:36.466040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:36.466548 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:36.495847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:36.504223 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a13b8833-78c5-42e9-b784-8e5178e781c6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1297 microversion: 2.1 time: 0.087551 Jul 12 18:52:36.504811 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 283/495] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:36 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:36.600885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:36.609472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:36.610907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:36.612082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cafc0215-8d17-4381-b922-15317891c4f6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.160771 Jul 12 18:52:36.612631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 213/496] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:36 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:52:37.522393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:37.522995 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:37.529019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:37.529461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:37.530406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:37.530645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:37.596405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:37.603922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c1fc8424-b675-4a09-9116-1cb161fb64cc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1297 microversion: 2.1 time: 0.087340 Jul 12 18:52:37.604630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 284/497] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:37 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:37.630740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:37.631413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:37.637919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:37.638370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:37.639224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:37.639842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:37.767023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:37.775388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:37.776829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:37.777967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0559f3f6-b84a-42b8-88cd-b3c34e25e3e6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.151339 Jul 12 18:52:37.778512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 214/498] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:37 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:38.622235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:38.622843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:38.625424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=74 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:38.630143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:38.630840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:38.631628 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:38.632062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:38.694451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:38.703035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8e5620e5-5258-4f43-b11a-9d8f3adc3a80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1297 microversion: 2.1 time: 0.083532 Jul 12 18:52:38.703658 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 285/499] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:38 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:38.795983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:38.796593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:38.803252 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:38.803740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:38.804500 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:38.804940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:39.148612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:39.157217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:39.158712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:39.159882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f869800d-bd74-4c74-a2f9-d148dd2095a0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1808 microversion: 2.20 time: 0.368091 Jul 12 18:52:39.160438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 215/500] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:38 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:39.719884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:39.720484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:39.726897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:39.727348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:39.728116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:39.728542 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:39.789474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:39.797800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dad0e068-f390-4dc1-b1e8-c831f4c79e2c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1297 microversion: 2.1 time: 0.081680 Jul 12 18:52:39.798393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 286/501] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:39 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:40.178956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:40.179815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:40.186779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:40.187262 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:40.188043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:40.188486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:40.326456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:40.335509 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:40.337026 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:40.338183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e6d2106b-0821-4e7c-a0aa-aacf4d15aadc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1795 microversion: 2.20 time: 0.163962 Jul 12 18:52:40.338739 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 216/502] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:52:40 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1795 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:52:40.813941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:40.815006 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:40.821417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:40.821869 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:40.823657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:40.824096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:40.975498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:40.984843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-94c9ec9f-47f6-44f8-9f53-f8947f1cf223 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.174726 Jul 12 18:52:40.985426 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 287/503] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:40 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:41.735971 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-c9e119a5-be13-4cbf-bbae-b789d367bc0c req-f1eaeef3-e674-45b0-843e-482e8b3884a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:41.747710 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c9e119a5-be13-4cbf-bbae-b789d367bc0c req-f1eaeef3-e674-45b0-843e-482e8b3884a6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:41.749091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c9e119a5-be13-4cbf-bbae-b789d367bc0c req-f1eaeef3-e674-45b0-843e-482e8b3884a6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:41.771435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-c9e119a5-be13-4cbf-bbae-b789d367bc0c req-f1eaeef3-e674-45b0-843e-482e8b3884a6 service nova] Creating event network-changed:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:52:41.777032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-c9e119a5-be13-4cbf-bbae-b789d367bc0c req-f1eaeef3-e674-45b0-843e-482e8b3884a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045054 Jul 12 18:52:41.777630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 217/504] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:52:42.002740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:42.003330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:42.009583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:42.010031 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:42.010936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:42.011230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:42.143134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:42.150595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5121a40b-f0a1-41f6-942a-8a3a6d921b18 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.152529 Jul 12 18:52:42.151152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 288/505] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:41 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:43.168028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:43.168730 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:43.172299 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:43.172983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=10 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:43.178066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:43.178465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:43.179232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:43.179697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:43.313060 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:43.320428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b5745cb3-e365-4370-b4c3-e92abd962902 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.156701 Jul 12 18:52:43.320986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 218/506] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:43 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:44.337813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:44.338416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:44.340294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:44.345372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:44.345814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:44.346577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:44.347091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:44.472403 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:44.474636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:44.480440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8095337a-e194-40d7-a9eb-5278bb42f4c7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.146529 Jul 12 18:52:44.481005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 289/507] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:44 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:45.498148 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:45.499375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:45.506104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:45.506547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:45.507357 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:45.507790 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:45.641859 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:45.649305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dd9a7a29-5a1b-4024-a0ce-6f995b53fc96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.155021 Jul 12 18:52:45.649868 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 219/508] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:45 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:46.669926 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:46.670579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:46.677133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:46.677579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:46.678336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:46.678771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:46.809252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:46.818652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1486f9d9-01c0-40ee-8b87-9c73dd845436 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.152560 Jul 12 18:52:46.819288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 290/509] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:46 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:47.836642 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:47.837245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:47.844676 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:47.845814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:47.846526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:47.847077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:47.981032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:47.989149 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-520571de-7163-4db7-b3ca-a4dd164e1001 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.156281 Jul 12 18:52:47.989738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 220/510] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:47 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:49.006234 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:49.006847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:49.012942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:49.013390 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:49.014192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:49.014858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:49.197757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:49.205297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0774a6a0-64f7-4363-a6ae-9442ab54f0ec tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.203223 Jul 12 18:52:49.205856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 291/511] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:49 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:50.222881 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:50.223521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:50.230045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:50.230483 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:50.231227 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:50.231711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:50.409069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:50.416443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4f5a094d-db37-46b5-ba46-d24c5b258ee5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.197394 Jul 12 18:52:50.416994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 221/512] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:50 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:52:51.433286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:51.433925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:51.440354 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:51.440804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:51.441564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:51.442003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:51.567060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:51.574434 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4b2e3c8c-1fbe-4391-8267-7282d16d879d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.145118 Jul 12 18:52:51.574994 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 292/513] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:51 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:52.591184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:52.591817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:52.598272 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:52.598715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:52.601055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:52.601055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:52.729647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:52.737844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9c0367cb-b41a-4e2e-89dc-2df63d0c383e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.150590 Jul 12 18:52:52.738402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 222/514] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:52 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:53.755627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:53.756507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:53.762667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:53.763109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:53.763907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:53.765248 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:53.894477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:53.901812 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2738ecef-8d5a-4226-949d-2c23a277870e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.150107 Jul 12 18:52:53.902376 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 293/515] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:53 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:54.918873 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:54.919543 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:54.922767 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:54.927736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:54.928193 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:54.930605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:54.930605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:55.061705 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:55.069218 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-75ce5159-2431-4511-8048-9cf91c408527 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.154401 Jul 12 18:52:55.069783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 223/516] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:54 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:56.086263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:56.086940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:56.094322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:56.094783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:56.095638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:56.096082 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:56.223813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:56.231055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-794c629d-da19-4d3d-a98d-81324c29e23d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.148702 Jul 12 18:52:56.231646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 294/517] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:56 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:57.248296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:57.248900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:57.255317 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:57.255762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:57.256766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:57.257191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:57.259697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=89 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:52:57.398909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:57.406729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-53ab46ae-bdcc-4d2f-a5a5-bffff21c3846 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.162196 Jul 12 18:52:57.407333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 224/518] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:57 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:57.785938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:57.786469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:57.792379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:57.793040 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:57.793990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:57.794432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:57.872314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-21c30ddd-909a-499d-b963-ce30f2edbfa6 req-08db6dac-bd16-4f30-b96a-121369c7e948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "name": "network-vif-plugged", "status": "completed", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:52:57.881628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-21c30ddd-909a-499d-b963-ce30f2edbfa6 req-08db6dac-bd16-4f30-b96a-121369c7e948 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:57.882068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-21c30ddd-909a-499d-b963-ce30f2edbfa6 req-08db6dac-bd16-4f30-b96a-121369c7e948 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:57.894314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-21c30ddd-909a-499d-b963-ce30f2edbfa6 req-08db6dac-bd16-4f30-b96a-121369c7e948 service nova] Creating event network-vif-plugged:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:52:57.899524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-21c30ddd-909a-499d-b963-ce30f2edbfa6 req-08db6dac-bd16-4f30-b96a-121369c7e948 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031040 Jul 12 18:52:57.900424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 225/519] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:52:57.929197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lazy-loading 'services' on Instance uuid d97c3762-a4f5-4d97-bd81-3ffd30a0b147 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:52:58.183135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6e24fdf9-fa5b-4927-ac05-ff8ead64d2b4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147/os-volume_attachments/cb11cc04-4f5e-47f1-84a6-9e81bc9b0f43" status: 202 len: 0 microversion: 2.1 time: 0.401089 Jul 12 18:52:58.184007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 295/520] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:52:57 2022] DELETE /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147/os-volume_attachments/cb11cc04-4f5e-47f1-84a6-9e81bc9b0f43 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:52:58.424362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:58.425027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:58.431143 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:58.431615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:58.432370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:58.432802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:58.561779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:58.573684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c6bfac04-f56d-40da-a8a4-f26065910404 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.150414 Jul 12 18:52:58.573684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 226/521] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:58 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:52:59.586988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:52:59.587726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:52:59.594891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:59.595363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:59.596130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:52:59.596569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:52:59.724968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:52:59.732286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-09931cd2-c25b-41c5-aa24-356b436dc5f6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.149673 Jul 12 18:52:59.732845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 296/522] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:52:59 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:00.750265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:00.750882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:00.757848 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:00.758297 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:00.759258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:00.759722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:00.892343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:00.899677 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c6c8c297-e75c-486b-a161-517f38454ec6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1370 microversion: 2.1 time: 0.154084 Jul 12 18:53:00.900229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 227/523] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:00 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:01.408889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:01.409508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:01.415242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.415712 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:01.416489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.416915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:01.442097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:53:01.704837 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f9015883-5d50-458f-bfb1-48b0aeb9ab32 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 204 len: 0 microversion: 2.1 time: 0.300148 Jul 12 18:53:01.705361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 297/524] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:53:01 2022] DELETE /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:53:01.713787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:01.714392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:01.721042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.721488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:01.722240 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.722668 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:01.853147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:01.861345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-42581acb-d972-4c2c-80ab-5d196e52b81a tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1513 microversion: 2.1 time: 0.151401 Jul 12 18:53:01.861917 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 228/525] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:01 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:01.916104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:01.916797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:01.922985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.923472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:01.924238 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:01.925165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:02.054145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:02.061490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b6de5677-f1f1-421c-8183-3da98032b060 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1565 microversion: 2.1 time: 0.149584 Jul 12 18:53:02.062578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 298/526] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:01 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:02.078737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:02.079223 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:02.085223 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:02.085671 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:02.086473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:02.086903 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:02.163376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-30e4eee3-e6aa-4a7f-a0a2-ab814c111099 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089070 Jul 12 18:53:02.163978 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 229/527] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 18:53:02 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:02.878113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:02.878842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:02.885323 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:02.885789 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:02.886606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:02.887042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:03.069174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:03.076965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-306ae929-ad2a-4087-8d2f-c759c1ac5cac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1513 microversion: 2.1 time: 0.202856 Jul 12 18:53:03.078034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 299/528] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:02 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:03.211086 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-aea39d20-9e81-4cb2-9ae6-f75889583326 req-b56d213d-8f81-4b06-b282-a3630b7b6642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:03.220059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-aea39d20-9e81-4cb2-9ae6-f75889583326 req-b56d213d-8f81-4b06-b282-a3630b7b6642 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:03.220497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-aea39d20-9e81-4cb2-9ae6-f75889583326 req-b56d213d-8f81-4b06-b282-a3630b7b6642 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:03.231344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-aea39d20-9e81-4cb2-9ae6-f75889583326 req-b56d213d-8f81-4b06-b282-a3630b7b6642 service nova] Creating event network-changed:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:53:03.236648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-aea39d20-9e81-4cb2-9ae6-f75889583326 req-b56d213d-8f81-4b06-b282-a3630b7b6642 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029710 Jul 12 18:53:03.237242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 230/529] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:04.095004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:04.095698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:04.105938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:04.106394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:04.108352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:04.110074 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:04.314383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:04.321988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0f5fa0d6-99fc-469e-be77-3e630e24b21d tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1513 microversion: 2.1 time: 0.231317 Jul 12 18:53:04.322578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 300/530] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:04 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1513 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:05.250957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-a30e2101-f007-400d-a882-ef3beaddb77f req-8022c43d-dafa-4994-9147-9c260d9c3094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d97c3762-a4f5-4d97-bd81-3ffd30a0b147", "name": "network-vif-deleted", "tag": "1828b832-4631-47ed-824c-2a2b6ee2dc31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:05.259977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-a30e2101-f007-400d-a882-ef3beaddb77f req-8022c43d-dafa-4994-9147-9c260d9c3094 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:05.260418 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-a30e2101-f007-400d-a882-ef3beaddb77f req-8022c43d-dafa-4994-9147-9c260d9c3094 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:05.271730 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-a30e2101-f007-400d-a882-ef3beaddb77f req-8022c43d-dafa-4994-9147-9c260d9c3094 service nova] Creating event network-vif-deleted:1828b832-4631-47ed-824c-2a2b6ee2dc31 for instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 on hv-cinder-83538 Jul 12 18:53:05.276399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-a30e2101-f007-400d-a882-ef3beaddb77f req-8022c43d-dafa-4994-9147-9c260d9c3094 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029419 Jul 12 18:53:05.277026 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 231/531] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:05.339335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:05.339979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:05.346817 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:05.347265 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:05.348050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:05.348484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:05.378534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:05.378972 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:05.379447 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lazy-loading 'fault' on Instance uuid d97c3762-a4f5-4d97-bd81-3ffd30a0b147 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:53:05.423592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:05.431060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-37d04e84-11b9-444e-9688-df31b4365515 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 200 len: 1308 microversion: 2.1 time: 0.095671 Jul 12 18:53:05.431831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 301/532] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:05 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:06.449538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:06.450233 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: d97c3762-a4f5-4d97-bd81-3ffd30a0b147] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:06.456467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:06.456909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:06.457700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:06.458122 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:06.471421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] HTTP exception thrown: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Request method failure captured: Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 HTTP/1.1 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcKt3BvJPOJ8v-Ttx_RY4hVHR1YvLh0e8WVtdC_1JmDMyQ34u519WybIx4F_nImvrqLweMb0wkCyBH5md-U3l04HQ0HTclM-aRGYoTsl8LQntpb-PbCA4ForgZFTlST_GgTQgTM770i-XgWwC9BFsCmWzXwrHEUGQsN_Hq8zWqhvaB8 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: ac5f763be1134225a570984c2bf62d3b Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:53:06.473044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ac5f763be1134225a570984c2bf62d3b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: ac5f763be1134225a570984c2bf62d3b Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesSnapshotTestJSON-453656177-project Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: a00e279ca0bb42ba935cb7b4fc75aa8d Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesSnapshotTestJSON-453656177-project Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. Jul 12 18:53:06.474662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'd97c3762-a4f5-4d97-bd81-3ffd30a0b147'} Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:53:06.475542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. Jul 12 18:53:06.476776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:53:06.477908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Returning 404 to user: Instance d97c3762-a4f5-4d97-bd81-3ffd30a0b147 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:53:06.477908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-303f4148-cac0-4daa-820e-8013b570c5ea tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147" status: 404 len: 111 microversion: 2.1 time: 0.029619 Jul 12 18:53:06.477908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 232/533] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:06 2022] GET /compute/v2.1/servers/d97c3762-a4f5-4d97-bd81-3ffd30a0b147 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:53:18.924158 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1826886792", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "networks": [{"uuid": "49cb6cc4-67d5-4173-81e1-c8021e43b5a8"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:18.931137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:18.931806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:18.976378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] validate_networks() for [('49cb6cc4-67d5-4173-81e1-c8021e43b5a8', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:53:19.323212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:53:19.323658 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:53:19.324122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:53:19.324644 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:53:19.325052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:53:19.334395 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:19.334862 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:19.335675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:19.336099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:19.351984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Getting quotas for project ac5f763be1134225a570984c2bf62d3b. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:53:19.355856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Getting quotas for user a00e279ca0bb42ba935cb7b4fc75aa8d and project ac5f763be1134225a570984c2bf62d3b. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:53:19.366457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:53:19.368734 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:53:19.496729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fd2a455c-8eae-4c3c-b35a-c287501c43e4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576485 Jul 12 18:53:19.497531 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 302/534] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:53:19.508441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-620d79f8-ef11-40c9-a63f-1de2130ae637 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:19.509006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-620d79f8-ef11-40c9-a63f-1de2130ae637 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:19.511387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=19 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:19.512037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=35 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:19.568402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-620d79f8-ef11-40c9-a63f-1de2130ae637 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:19.575606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-620d79f8-ef11-40c9-a63f-1de2130ae637 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1219 microversion: 2.1 time: 0.071456 Jul 12 18:53:19.580278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 233/535] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:19 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:20.592938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:20.593549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:20.600240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:20.600686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:20.601474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:20.601907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:20.662528 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:20.669892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e3e131dc-5bb8-42c7-a5dd-741d871dcaa9 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1223 microversion: 2.1 time: 0.080865 Jul 12 18:53:20.670458 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 303/536] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:20 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:21.688084 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:21.688670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:21.696288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:21.696746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:21.697506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:21.697934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:21.771702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:21.778327 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-df5343a4-02a6-40fa-9cdc-d064de4096f4 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1289 microversion: 2.1 time: 0.093983 Jul 12 18:53:21.778888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 234/537] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:21 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:22.796320 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:22.797557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:22.804355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:22.804807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:22.805578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:22.806020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:23.013577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:23.023013 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c7395879-4f55-42d5-8537-fe00521ee104 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.230532 Jul 12 18:53:23.032538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 304/538] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:22 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:23.452469 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-fc4eda81-69f9-410f-a5e8-17b6e7b3b83c req-72a2d7ea-5f9c-40d9-a3bf-7e1c2cf959b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ce64f5a-4e90-4ff4-8775-99be60017b5a", "tag": "294666a0-4025-492f-a600-48f1cfdd9d96"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:23.467823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-fc4eda81-69f9-410f-a5e8-17b6e7b3b83c req-72a2d7ea-5f9c-40d9-a3bf-7e1c2cf959b5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:23.468633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-fc4eda81-69f9-410f-a5e8-17b6e7b3b83c req-72a2d7ea-5f9c-40d9-a3bf-7e1c2cf959b5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:23.484107 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-fc4eda81-69f9-410f-a5e8-17b6e7b3b83c req-72a2d7ea-5f9c-40d9-a3bf-7e1c2cf959b5 service nova] Creating event network-changed:294666a0-4025-492f-a600-48f1cfdd9d96 for instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a on hv-cinder-83538 Jul 12 18:53:23.489480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-fc4eda81-69f9-410f-a5e8-17b6e7b3b83c req-72a2d7ea-5f9c-40d9-a3bf-7e1c2cf959b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043727 Jul 12 18:53:23.490139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 235/539] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:24.040110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:24.040719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:24.046967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:24.048263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:24.049037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:24.049472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:24.256263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:24.264034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ce5da8a1-108a-440b-b9bc-7f133a9a270c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.227609 Jul 12 18:53:24.264690 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 305/540] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:24 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:25.291375 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:25.292082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:25.298274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:25.298725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:25.299538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:25.300918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:25.427945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:25.440958 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a297968c-11ed-4070-b823-e4cbb96c9869 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.154076 Jul 12 18:53:25.441537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 236/541] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:25 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:26.460370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:26.460988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:26.466931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:26.467393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:26.468146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:26.468573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:26.599149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:26.606533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-14cbbe54-117e-4b59-81a6-a52331171b7f tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.150088 Jul 12 18:53:26.607098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 306/542] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:26 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:27.441658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:27.442169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:27.448150 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:27.448594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:27.449342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:27.449767 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:27.570094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lazy-loading 'services' on Instance uuid 79956b08-375e-45c0-8616-a59bdbe15dea {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:53:27.624229 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:27.624772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:27.631342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:27.632044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:27.632893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:27.633217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:27.765889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:27.773240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-aa9a758e-6e52-466b-a801-15e18afe5c4c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.152965 Jul 12 18:53:27.779366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 307/543] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:27 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:27.831436 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-12a3d892-e762-48c3-a15f-802a224b9dd1 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments/0349873c-ca38-4d04-9e1f-86d4682591b1" status: 202 len: 0 microversion: 2.1 time: 0.498452 Jul 12 18:53:27.832187 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 237/544] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:53:27 2022] DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments/0349873c-ca38-4d04-9e1f-86d4682591b1 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:53:28.790962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:28.791604 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:28.797726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:28.798172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:28.798924 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:28.799386 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:28.929911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:28.937368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-49031f1f-dcc1-4077-8235-f38297846dc2 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.150209 Jul 12 18:53:28.937923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 308/545] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:28 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:29.954221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:29.954920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:29.961264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:29.963494 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:29.963946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:29.964720 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:29.965152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:30.000293 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-672a5fb4-2409-439c-9fad-d489292f0c4d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:30.002263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:30.002920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:30.008415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-672a5fb4-2409-439c-9fad-d489292f0c4d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:30.009075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-672a5fb4-2409-439c-9fad-d489292f0c4d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:30.071282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-672a5fb4-2409-439c-9fad-d489292f0c4d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Going to try to stop instance {{(pid=124971) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 12 18:53:30.101841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:30.109157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f447f08d-f4d1-4035-9ca2-58de5abbbd53 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.159056 Jul 12 18:53:30.109750 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 238/546] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:29 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:30.234845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-672a5fb4-2409-439c-9fad-d489292f0c4d tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action" status: 202 len: 0 microversion: 2.1 time: 0.238371 Jul 12 18:53:30.235558 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 309/547] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:53:29 2022] POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:53:30.244016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:30.244625 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:30.250531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:30.250977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:30.251759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:30.252182 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:30.387621 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:30.395778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-17a1b094-6863-4fbc-b207-1cfc97025567 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.155562 Jul 12 18:53:30.396334 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 239/548] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:30 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:31.126575 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:31.134268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:31.134268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:31.134564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:31.135346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:31.135777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:31.265416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:31.273207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d242d67b-cee5-4ee7-b794-927c8046aaac tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.150928 Jul 12 18:53:31.273775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 310/549] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:31 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:31.415115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:31.415672 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:31.422260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:31.422709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:31.423507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:31.423944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:31.554050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:31.561593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c0092485-7617-4071-98b1-03ee394f687f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.150596 Jul 12 18:53:31.566261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 240/550] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:31 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:32.248249 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-a2ab75b8-28e4-4f6b-b1bb-adccdc6502c3 req-0423aadc-03bf-4ed0-9a31-a90363ca3d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce64f5a-4e90-4ff4-8775-99be60017b5a", "name": "network-vif-plugged", "status": "completed", "tag": "294666a0-4025-492f-a600-48f1cfdd9d96"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:32.257278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a2ab75b8-28e4-4f6b-b1bb-adccdc6502c3 req-0423aadc-03bf-4ed0-9a31-a90363ca3d0d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:32.257720 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-a2ab75b8-28e4-4f6b-b1bb-adccdc6502c3 req-0423aadc-03bf-4ed0-9a31-a90363ca3d0d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:32.268606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-a2ab75b8-28e4-4f6b-b1bb-adccdc6502c3 req-0423aadc-03bf-4ed0-9a31-a90363ca3d0d service nova] Creating event network-vif-plugged:294666a0-4025-492f-a600-48f1cfdd9d96 for instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a on hv-cinder-83538 Jul 12 18:53:32.273798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-a2ab75b8-28e4-4f6b-b1bb-adccdc6502c3 req-0423aadc-03bf-4ed0-9a31-a90363ca3d0d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029359 Jul 12 18:53:32.274398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 311/551] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:32.289889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:32.290488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:32.296451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:32.296875 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:32.297621 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:32.300493 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:32.441235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:32.448757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-39afd873-48c6-4d45-aa45-d73afce11812 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.162781 Jul 12 18:53:32.449355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 241/552] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:32 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:32.581759 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:32.582459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:32.588697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:32.589144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:32.589900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:32.590326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:32.769799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:32.777450 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1cb7f756-005b-4169-bdbd-7a57fce7311f tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.200191 Jul 12 18:53:32.778036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 312/553] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:32 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:33.465928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:33.466538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:33.473294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:33.473742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:33.474503 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:33.474936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:33.606023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:33.613598 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-269491d9-7be8-47f7-aa31-6d1ec063455b tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.151511 Jul 12 18:53:33.614159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 242/554] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:33 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:33.795140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:33.795709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:33.802503 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:33.802949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:33.803742 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:33.804173 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:33.931208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:33.938569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a975a7a7-46bd-4507-91bf-061df9bf1e98 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.147369 Jul 12 18:53:33.939146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 313/555] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:33 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:34.629908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:34.630510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:34.637265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:34.637712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:34.638468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:34.638900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:34.766156 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:34.775161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2fe04e94-2624-4284-a3fc-bfd915986833 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1319 microversion: 2.1 time: 0.149086 Jul 12 18:53:34.775969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 243/556] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:34 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:34.956416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:34.957027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:34.963091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:34.963568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:34.964325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:34.964756 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:35.097831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:35.105407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6af149aa-e283-4e35-8f9a-bc1b9bacda30 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.152957 Jul 12 18:53:35.105973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 314/557] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:34 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:35.847899 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:35.848504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:35.855016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:35.855497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:35.856260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:35.856692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:35.985986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:35.994281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-90fd8a06-a960-4368-9384-dcc5a5ed5b1c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1508 microversion: 2.1 time: 0.150608 Jul 12 18:53:35.995449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 244/558] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:35 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:36.014347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51a5937b-f3c2-48e4-8372-2e892ee5ef9c", "device": "/dev/sdb"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:36.016091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:36.022601 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:36.023059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:36.023894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:36.029701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:36.122985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:36.123539 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:36.130114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:36.131364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:36.132742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:36.133183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:36.268509 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:36.276026 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f11a9d19-c30c-4ba9-8004-fd84e35e247a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.156942 Jul 12 18:53:36.276583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 245/559] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:36 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:36.718179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e3d32c3e-e3fc-41cd-b060-c25ef181a4a3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "POST /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.707757 Jul 12 18:53:36.718893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 315/560] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:53:36 2022] POST /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a/os-volume_attachments => generated 194 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:53:37.293761 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:37.294305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:37.300839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:37.301283 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:37.302037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:37.302467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:37.433688 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:37.441811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e664010c-2592-4c0c-b2ce-4bf3121b821e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.152107 Jul 12 18:53:37.442380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 246/561] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:37 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:38.460331 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:38.461061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:38.467269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:38.467735 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:38.468479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:38.468906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:38.595977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:38.603776 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-035d36b2-ccfe-48c3-97bf-a8ab9e0efc20 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.148597 Jul 12 18:53:38.604464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 316/562] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:38 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:39.621061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:39.621662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:39.628049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:39.628955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:39.629844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:39.630273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:39.758523 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:39.765986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a1651fc1-8e7e-4400-a51d-e273deb308cb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.148813 Jul 12 18:53:39.766562 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 247/563] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:39 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:40.783625 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:40.784627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:40.791237 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:40.791718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:40.792481 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:40.792914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:40.810888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:40.922925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:40.929417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eb3e0c0f-1b97-4465-9b82-739b3fecb538 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1678 microversion: 2.1 time: 0.149652 Jul 12 18:53:40.929990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 317/564] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:40 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:41.722816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:41.723877 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:41.730495 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.730938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.731735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.732201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.946529 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:41.947197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:41.947627 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6e60d084-9c3f-407d-9abc-3a9b372d3f6a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.229218 Jul 12 18:53:41.948341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 248/565] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:53:41 2022] POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:53:41.954456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.954906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.956843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.957513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:41.957629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.958290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:41.964729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.965188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.965959 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:41.966452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:41.985265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:42.208304 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:42.215737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-570ec9fb-52d7-4b05-aa8a-9903a2fa251e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1655 microversion: 2.1 time: 0.273383 Jul 12 18:53:42.216318 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 318/566] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:41 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1655 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:42.232765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a94b7d8c-62ee-4120-acff-ba4ce5a244e8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:53:42.238927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a94b7d8c-62ee-4120-acff-ba4ce5a244e8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:42.239490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a94b7d8c-62ee-4120-acff-ba4ce5a244e8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:42.242964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:42.251259 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6394d3a8-5f43-4a14-aa1d-b99860b39ce8 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1751 microversion: 2.1 time: 0.298660 Jul 12 18:53:42.251856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 249/567] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:41 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1751 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:42.269413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a94b7d8c-62ee-4120-acff-ba4ce5a244e8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Going to try to start instance {{(pid=124971) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 12 18:53:42.441623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a94b7d8c-62ee-4120-acff-ba4ce5a244e8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action" status: 202 len: 0 microversion: 2.1 time: 0.212422 Jul 12 18:53:42.446505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 319/568] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:53:42 2022] POST /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:53:42.450548 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:42.451396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:42.458351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:42.458826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:42.459641 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:42.460071 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:42.683250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:42.692604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2f91dcb2-badf-4d33-b1b8-37141c8fd43c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1664 microversion: 2.1 time: 0.246146 Jul 12 18:53:42.693365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 250/569] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:42 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1664 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:43.270406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:43.271129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:43.277286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:43.277729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:43.278485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:43.278914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:43.421105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:43.429195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-213f13b1-db16-46d1-82a8-5539544026c0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.163475 Jul 12 18:53:43.429777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 320/570] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:43 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:43.710251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:43.710816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:43.717238 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:43.717678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:43.718430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:43.718886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:43.854068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:43.862841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-80c98ca3-1b27-48c0-bdd6-f6e3566bcf50 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1664 microversion: 2.1 time: 0.157130 Jul 12 18:53:43.863430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 251/571] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:43 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:44.446725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:44.447268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:44.454140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:44.454588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:44.456070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:44.456781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:44.600960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:44.608919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dfed3637-0fb7-41e4-9687-732a700198dd tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.166286 Jul 12 18:53:44.609485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 321/572] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:44 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:44.881213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:44.881821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:44.888673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:44.889126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:44.889889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:44.893771 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:45.019781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:45.027329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-79547bdf-f9d0-4385-8a21-b771aa58f04a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1664 microversion: 2.1 time: 0.150666 Jul 12 18:53:45.027892 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 252/573] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:44 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:45.626762 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:45.627470 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:45.634449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:45.634895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:45.635807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:45.636237 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:45.787277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:45.795445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-39d5c8c1-92fa-4e58-980b-c129a2efd306 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.172354 Jul 12 18:53:45.795948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 322/574] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:45 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:46.051821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:46.052424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:46.058784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:46.059224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:46.060006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:46.060436 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:46.186609 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:46.194623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8699c1c1-b300-4e97-bbcb-b2e0e3600b25 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1668 microversion: 2.1 time: 0.146683 Jul 12 18:53:46.195173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 253/575] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:46 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:46.812521 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:46.813164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:46.819742 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:46.820193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:46.820952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:46.821422 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:46.963004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:46.970880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cef1e5b5-6605-449a-a51c-5cd68517e865 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.162350 Jul 12 18:53:46.971976 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 323/576] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:46 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:47.988675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:47.989316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:47.995750 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:47.996195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:47.996951 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:47.997382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:48.136929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:48.145067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7c2d64a7-ddd9-4376-8abe-2ec6e0247d71 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.160750 Jul 12 18:53:48.145640 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 254/577] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:47 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:49.162307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:49.162919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:49.165383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:49.170208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:49.170656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:49.171458 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:49.171892 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:49.325286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:49.334134 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-71d03418-e668-48d7-96e1-e0fe6105bf6c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.176069 Jul 12 18:53:49.334709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 324/578] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:49 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:50.354649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:50.355287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:50.357590 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=47 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:53:50.362320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:50.363288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:50.364074 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:50.364505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:50.507051 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:50.515151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-69164772-6e4d-4bf7-8a29-cab12a6a2bcf tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.164379 Jul 12 18:53:50.515788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 255/579] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:50 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:51.532207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:51.532814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:51.539480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:51.539915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:51.540684 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:51.541090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:51.684958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:51.693126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bfda034e-5d95-418a-9b04-95ea563ddd5c tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.164930 Jul 12 18:53:51.693680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 325/580] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:51 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:53:52.710482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:52.711089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:52.717795 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:52.718242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:52.718994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:52.719462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:52.865248 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:52.873489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e35b39a0-c5cc-4d62-aa35-1c3afd0b771b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.167494 Jul 12 18:53:52.874047 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 256/581] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:52 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:53.891576 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:53.892192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:53.899394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:53.899845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:53.900602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:53.901036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:54.043668 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:54.051875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eba230e9-c132-40e8-b714-fde63e28425d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.164166 Jul 12 18:53:54.052435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 326/582] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:53 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:55.068742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:55.069353 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:55.075872 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:55.076318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:55.077078 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:55.077513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:55.217935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:55.226554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cafe2fa3-bd6e-4b7f-85d9-82ffd4d01d79 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.161735 Jul 12 18:53:55.227113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 257/583] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:55 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:56.244338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:56.245295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:56.251363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:56.251806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:56.252560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:56.252983 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:56.397877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:56.405746 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0a92a2f4-1d7c-41b6-be00-301c3463ccae tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.165401 Jul 12 18:53:56.406320 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 327/584] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:56 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:57.423618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:57.424245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:57.430725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:57.431170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:57.431977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:57.432409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:57.571741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:57.579778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9fe181ee-bccc-49f0-bbbe-a236c3adcc65 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.159997 Jul 12 18:53:57.580333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 258/585] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:57 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:53:58.596676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:53:58.597212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:53:58.603989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:58.604435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:58.605190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:53:58.605618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:53:58.976126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:53:58.984009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6b295362-92de-42ae-af80-a908bb373de5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.391297 Jul 12 18:53:58.984565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 328/586] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:58 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:00.002414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:00.003070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:00.010825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:00.011277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:00.012212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:00.012662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:00.160078 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:00.168752 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7e8ad11d-a574-4dac-8a8c-cbafdf023009 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.170261 Jul 12 18:54:00.169309 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 259/587] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:53:59 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:01.186098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:01.186758 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:01.193975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:01.194435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:01.195177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:01.195645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:01.350071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:01.358011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c11a0a31-340d-4997-9d4d-8cbde9eaecba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.175917 Jul 12 18:54:01.358736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 329/588] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:01 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:01.902736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:01.903212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:01.909615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:01.910062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:01.910864 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:01.914052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:01.993444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lazy-loading 'services' on Instance uuid 8ce64f5a-4e90-4ff4-8775-99be60017b5a {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:54:02.222298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-04a4c4de-d99b-4b88-997e-1b8c9b4d82fe tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a/os-volume_attachments/51a5937b-f3c2-48e4-8372-2e892ee5ef9c" status: 202 len: 0 microversion: 2.1 time: 0.323300 Jul 12 18:54:02.222942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 260/589] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:54:01 2022] DELETE /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a/os-volume_attachments/51a5937b-f3c2-48e4-8372-2e892ee5ef9c => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 18:54:02.375226 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:02.375875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:02.383545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:02.383945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:02.384711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:02.385144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:02.525017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:02.532959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b96d5c77-5fa4-4164-994d-22b686189d38 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.161504 Jul 12 18:54:02.533524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 330/590] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:02 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:03.552554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:03.553164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:03.559549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:03.562549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:03.562549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:03.562549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:03.711054 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:03.719172 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f7b8807e-4700-42c8-95a2-f398a0a50c15 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.172172 Jul 12 18:54:03.720144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 261/591] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:03 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:04.386388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:04.386897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:04.393466 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.393919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.394676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.395109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.420478 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:54:04.528486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:04.709105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9d519f33-0261-422f-915b-2d256a54cc37 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 204 len: 0 microversion: 2.1 time: 0.326463 Jul 12 18:54:04.709650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 331/592] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:54:04 2022] DELETE /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:54:04.717997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:04.719617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:04.725608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.726057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.726845 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.727279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.737701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:04.738339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:04.746657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.748342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.748342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:04.748342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:04.930884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:04.938386 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fd7ac851-af69-4076-bc6c-4f2d3493ac74 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1514 microversion: 2.1 time: 0.224276 Jul 12 18:54:04.939026 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 262/593] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:04 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:04.945965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:04.953777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-15eac2bc-94e6-4577-9386-68b468b74351 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.220276 Jul 12 18:54:04.954331 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 332/594] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:04 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:54:05.956035 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:05.963515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:05.963964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:05.964405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:05.965165 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:05.965589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:05.969817 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:05.970432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:05.977475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:05.977929 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:05.978695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:05.979131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:06.164781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:06.172224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d147e726-eb24-4ccb-8fba-7440f3b6ebc1 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1514 microversion: 2.1 time: 0.220080 Jul 12 18:54:06.172794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 263/595] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:05 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:06.189594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:06.198066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2d5e5e5d-0801-4801-a598-3e525485d0e1 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.232126 Jul 12 18:54:06.198635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 333/596] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:05 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:54:07.190042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:07.190584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:07.197631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:07.198079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:07.198849 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:07.199282 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:07.214424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:07.215073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:07.221752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:07.222215 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:07.222988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:07.223464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:07.408327 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:07.417603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7f3b5640-6245-4037-8ae3-8dfbdb9b72f3 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1514 microversion: 2.1 time: 0.231400 Jul 12 18:54:07.418872 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 264/597] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:07 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:07.424744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:07.433677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f5e6a973-b4e5-4772-9b64-2a79829eb3ba tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1756 microversion: 2.1 time: 0.223094 Jul 12 18:54:07.434436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 334/598] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:07 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:07.763927 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-6bfa3407-1081-449d-8011-ece9f2289f82 req-5fa5fa8a-982e-4dc8-a732-33efaeb773be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ce64f5a-4e90-4ff4-8775-99be60017b5a", "name": "network-vif-deleted", "tag": "294666a0-4025-492f-a600-48f1cfdd9d96"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:07.772105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-6bfa3407-1081-449d-8011-ece9f2289f82 req-5fa5fa8a-982e-4dc8-a732-33efaeb773be service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:07.772547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-6bfa3407-1081-449d-8011-ece9f2289f82 req-5fa5fa8a-982e-4dc8-a732-33efaeb773be service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:07.782982 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-6bfa3407-1081-449d-8011-ece9f2289f82 req-5fa5fa8a-982e-4dc8-a732-33efaeb773be service nova] Creating event network-vif-deleted:294666a0-4025-492f-a600-48f1cfdd9d96 for instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a on hv-cinder-83538 Jul 12 18:54:07.788517 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-6bfa3407-1081-449d-8011-ece9f2289f82 req-5fa5fa8a-982e-4dc8-a732-33efaeb773be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081882 Jul 12 18:54:07.789085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 265/599] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:54:08.435652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:08.436284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:08.442753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:08.443192 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:08.444739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:08.445170 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:08.451912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:08.453157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:08.460046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:08.460508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:08.461285 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:08.461727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:08.465879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:08.514251 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a00e279ca0bb42ba935cb7b4fc75aa8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5f763be1134225a570984c2bf62d3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:08.523520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-45775eee-7f16-41af-80dd-8b6bd6d67803 tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 200 len: 1304 microversion: 2.1 time: 0.091615 Jul 12 18:54:08.524335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 335/600] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:08 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:08.621370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:08.629717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e2835827-1934-47a1-a27e-c193493cf1f9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1759 microversion: 2.1 time: 0.182535 Jul 12 18:54:08.630279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 266/601] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:08 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:54:09.541065 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:09.541671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] [instance: 8ce64f5a-4e90-4ff4-8775-99be60017b5a] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:09.548097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:09.548547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:09.549301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:09.549731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:09.563461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] HTTP exception thrown: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Request method failure captured: Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a HTTP/1.1 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcKt3BvJPOJ8v-Ttx_RY4hVHR1YvLh0e8WVtdC_1JmDMyQ34u519WybIx4F_nImvrqLweMb0wkCyBH5md-U3l04HQ0HTclM-aRGYoTsl8LQntpb-PbCA4ForgZFTlST_GgTQgTM770i-XgWwC9BFsCmWzXwrHEUGQsN_Hq8zWqhvaB8 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: ac5f763be1134225a570984c2bf62d3b Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:54:09.565105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ac5f763be1134225a570984c2bf62d3b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ac5f763be1134225a570984c2bf62d3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: ac5f763be1134225a570984c2bf62d3b Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-453656177 Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesSnapshotTestJSON-453656177-project Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: a00e279ca0bb42ba935cb7b4fc75aa8d Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesSnapshotTestJSON-453656177-project Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. Jul 12 18:54:09.566551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '8ce64f5a-4e90-4ff4-8775-99be60017b5a'} Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:54:09.567278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. Jul 12 18:54:09.573005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:54:09.574352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] Returning 404 to user: Instance 8ce64f5a-4e90-4ff4-8775-99be60017b5a could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:54:09.574352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-98b2613e-5d9b-4a66-ba34-b25148bb212c tempest-VolumesSnapshotTestJSON-453656177 tempest-VolumesSnapshotTestJSON-453656177-project] 10.222.0.59 "GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a" status: 404 len: 111 microversion: 2.1 time: 0.030021 Jul 12 18:54:09.574352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 336/602] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:54:09 2022] GET /compute/v2.1/servers/8ce64f5a-4e90-4ff4-8775-99be60017b5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:54:10.845639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:10.846152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:10.852970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:10.853413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:10.854180 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:10.854611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:10.883049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-30c2f9eb-c71e-4531-b506-d02162e55fd0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments/1b8d3c91-32ec-41b9-950b-3f96068053f6" status: 200 len: 194 microversion: 2.20 time: 0.142250 Jul 12 18:54:10.883648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 267/603] 10.222.0.59 () {60 vars in 1453 bytes} [Tue Jul 12 18:54:10 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments/1b8d3c91-32ec-41b9-950b-3f96068053f6 => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:54:10.945514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:10.945987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:10.952402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:10.952842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:10.953579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:10.954002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:11.032308 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lazy-loading 'services' on Instance uuid a96074e1-9b57-4f07-8745-60c7e8446aa9 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:54:11.236701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ac963be7-1c2f-47de-8374-eabc74a243c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments/1b8d3c91-32ec-41b9-950b-3f96068053f6" status: 202 len: 0 microversion: 2.20 time: 0.294940 Jul 12 18:54:11.237327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 337/604] 10.222.0.59 () {60 vars in 1456 bytes} [Tue Jul 12 18:54:10 2022] DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments/1b8d3c91-32ec-41b9-950b-3f96068053f6 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:54:11.246306 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:11.247287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:11.253377 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:11.253828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:11.254597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:11.255032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:11.286899 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e1a586d5-de43-4fb9-9427-74f45ac0ab84 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044448 Jul 12 18:54:11.288486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 268/605] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Jul 12 18:54:11 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:54:12.301146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:12.302235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:12.309351 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:12.309802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:12.310547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:12.310972 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:12.339958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b50e5344-3dd8-46ba-88d2-584e0b735b71 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043679 Jul 12 18:54:12.340525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 338/606] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Jul 12 18:54:12 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:54:13.351251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:13.352202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:13.358764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.359207 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.359988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.360422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.390851 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-82a7330a-5ca6-4b1a-8a25-aa58f465a8be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043922 Jul 12 18:54:13.391419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 269/607] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Jul 12 18:54:13 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:54:13.449226 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:13.449697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:13.456394 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.456841 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.457597 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.458028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.482126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:54:13.791447 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-de574083-69d2-4bd8-a533-6b93114f45ec tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 204 len: 0 microversion: 2.20 time: 0.345657 Jul 12 18:54:13.792029 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 339/608] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Jul 12 18:54:13 2022] DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:54:13.800164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:13.800805 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:13.808104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.808555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.809309 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:13.809772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:13.941898 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:13.949944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:13.951557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:13.952706 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b0059176-1f03-4873-ab48-58b04c5d2557 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.156420 Jul 12 18:54:13.953291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 270/609] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:13 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:54:14.971609 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:14.972304 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:14.979833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:14.980281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:14.981038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:14.981470 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:15.110522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:15.118538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:15.120093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:15.121243 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7d78c0d2-8453-4e2d-a9b2-33b4c0f13a4d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.153952 Jul 12 18:54:15.121807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 340/610] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:14 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:16.139095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:16.139717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:16.146300 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:16.146744 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:16.147723 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:16.148154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:16.278062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:16.286000 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:16.288512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:16.289680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6b137ac7-5c63-4e01-a420-921695d0b58e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.154531 Jul 12 18:54:16.290244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 271/611] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:16 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:17.308751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:17.309406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:17.315958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:17.316398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:17.317145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:17.317570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:17.453122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:17.461137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:17.462639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:17.463842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0477716e-8b95-4f93-aea2-a12ba6fbb484 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.158967 Jul 12 18:54:17.464408 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 341/612] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:17 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:18.482101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:18.482738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:18.489317 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:18.489766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:18.490582 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:18.491020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:18.621674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:18.629595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:18.631109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:18.633155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9d3b940b-3ad4-42ce-8871-f2513d273784 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.154802 Jul 12 18:54:18.633719 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 272/613] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:18 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:19.651987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:19.652621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:19.655500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:19.662880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:19.663594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:19.664363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:19.664985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:19.800132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:19.809027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:19.810670 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:19.811851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-478e443f-7242-479e-8b4b-67654bbf929d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1723 microversion: 2.20 time: 0.163930 Jul 12 18:54:19.812409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 342/614] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:19 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:20.134402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-b21fd05d-3cfc-4b9a-a345-f6a1e29a2a26 req-2129d779-9826-4744-aa1a-572e721b5083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96074e1-9b57-4f07-8745-60c7e8446aa9", "name": "network-vif-deleted", "tag": "e380aa7c-8535-431d-a4d8-8db21dfc9547"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:20.142941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b21fd05d-3cfc-4b9a-a345-f6a1e29a2a26 req-2129d779-9826-4744-aa1a-572e721b5083 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:20.143417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b21fd05d-3cfc-4b9a-a345-f6a1e29a2a26 req-2129d779-9826-4744-aa1a-572e721b5083 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:20.156176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-b21fd05d-3cfc-4b9a-a345-f6a1e29a2a26 req-2129d779-9826-4744-aa1a-572e721b5083 service nova] Creating event network-vif-deleted:e380aa7c-8535-431d-a4d8-8db21dfc9547 for instance a96074e1-9b57-4f07-8745-60c7e8446aa9 on hv-cinder-83538 Jul 12 18:54:20.162294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-b21fd05d-3cfc-4b9a-a345-f6a1e29a2a26 req-2129d779-9826-4744-aa1a-572e721b5083 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031829 Jul 12 18:54:20.164166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 273/615] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:54:20.830047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:20.832960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:20.840738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:20.843851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:20.845174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:20.847389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:20.891527 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:20.891975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:20.892628 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lazy-loading 'fault' on Instance uuid a96074e1-9b57-4f07-8745-60c7e8446aa9 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:54:20.939112 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:20.949169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:20.950677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:20.951911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-acb482d7-a1be-417b-b2f7-62eb844524d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 200 len: 1371 microversion: 2.20 time: 0.125834 Jul 12 18:54:20.952475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 343/616] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:20 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:21.971290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:21.972049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:21.974047 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=38 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:21.979260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:21.979739 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:21.980507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:21.980937 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:21.995039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 HTTP/1.1 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:54:21.996736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:54:21.998453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'a96074e1-9b57-4f07-8745-60c7e8446aa9'} Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:54:21.999417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:54:22.000895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:54:22.002220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:54:22.002220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2eefeaa1-8007-4de8-9907-e26b522cfe6c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 404 len: 111 microversion: 2.20 time: 0.031629 Jul 12 18:54:22.002220 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 274/617] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:21 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:54:22.008352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1e28ac0e-a0c8-46bd-a930-fbc0b1d6971c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '.version_select at 0x7f01784cc700>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:22.012021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e28ac0e-a0c8-46bd-a930-fbc0b1d6971c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [88300aa1-83bd-4dcd-94c4-b70dd0a61fcf] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 12 18:54:23.021404 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e28ac0e-a0c8-46bd-a930-fbc0b1d6971c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [88300aa1-83bd-4dcd-94c4-b70dd0a61fcf] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 37234. Jul 12 18:54:23.129937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1e28ac0e-a0c8-46bd-a930-fbc0b1d6971c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629255310" status: 204 len: 0 microversion: 2.20 time: 1.126413 Jul 12 18:54:23.130541 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 344/618] 10.222.0.59 () {60 vars in 1258 bytes} [Tue Jul 12 18:54:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629255310 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 12 18:54:24.127413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9889dc63-30b0-49e8-85c5-98bb2f40ab5c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: .version_select at 0x7f0178312b80>, body: {"keypair": {"name": "tempest-keypair-349192338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ3qTTxhMMsTuF1Ll5UnF4G06TCON/2vAQlTqyy76dQf3Tx30NxQ/vGsKYscduUPdAucpSNnAC/FwjIZ+oqoVnoE+VimFNd8y1cPfaGvkbmgGuSCeN6J52Tmb/zFeH6Lw=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:24.142147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-9889dc63-30b0-49e8-85c5-98bb2f40ab5c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:54:24.145986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-9889dc63-30b0-49e8-85c5-98bb2f40ab5c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for user 08ded0d15f774b2f8a63f9bcbe0f8743 and project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:54:24.269371 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9889dc63-30b0-49e8-85c5-98bb2f40ab5c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.146141 Jul 12 18:54:24.269974 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 275/619] 10.222.0.59 () {62 vars in 1199 bytes} [Tue Jul 12 18:54:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 147 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 12 18:54:26.558879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-218958477", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e09cbd83-6a94-4cfd-aea1-1ab194bc236c"}], "security_groups": [{"name": "tempest-securitygroup--1255799931"}], "key_name": "tempest-keypair-349192338", "user_data": "}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:26.667022 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] validate_networks() for [('e09cbd83-6a94-4cfd-aea1-1ab194bc236c', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:54:27.035870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:54:27.036287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:54:27.036751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:54:27.037151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:54:27.038209 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:54:27.046952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:27.047417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:27.048193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:27.048621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:27.064980 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:54:27.069017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Getting quotas for user 08ded0d15f774b2f8a63f9bcbe0f8743 and project a2be77c6adbb48db9d2ddffe91cb1496. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:54:27.079646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:54:27.081871 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:54:27.221829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f835686d-3fe1-4fda-bccc-b221489ae7db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.667486 Jul 12 18:54:27.222502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 345/620] 10.222.0.59 () {62 vars in 1187 bytes} [Tue Jul 12 18:54:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 12 18:54:27.233178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:27.233876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:27.289419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:27.296778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:27.298336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:27.299472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-660da363-a5f5-49c5-8a23-04f11ba1e257 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1280 microversion: 2.20 time: 0.070810 Jul 12 18:54:27.300030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 276/621] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:27 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:28.318389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:28.319183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:28.325389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:28.329269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:28.329269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:28.329269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:28.391604 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:28.400216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:28.401702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:28.402779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-163a0430-339a-484b-8400-4f266b0f2fb1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1284 microversion: 2.20 time: 0.089128 Jul 12 18:54:28.411425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 346/622] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:28 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:29.423164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:29.423799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:29.431363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:29.432102 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:29.433318 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:29.433908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:29.504525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:29.513911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:29.515477 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:29.516580 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-710e9b22-a8f8-43df-861f-a03fc34319bb tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1350 microversion: 2.20 time: 0.098604 Jul 12 18:54:29.517140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 277/623] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:29 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:30.535962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:30.536564 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:30.543132 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:30.543616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:30.544372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:30.544806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:30.684038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:30.687696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:30.693502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:30.695197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:30.696826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ca376604-af6c-40b1-af71-c67d596d1419 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.165150 Jul 12 18:54:30.697874 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 347/624] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:30 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:30.915737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-b4970d7d-59df-4807-bcaf-03c59b1983fe req-d18b05a0-d957-4e64-963f-75e78b44ac0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:30.925490 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b4970d7d-59df-4807-bcaf-03c59b1983fe req-d18b05a0-d957-4e64-963f-75e78b44ac0c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:30.925936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b4970d7d-59df-4807-bcaf-03c59b1983fe req-d18b05a0-d957-4e64-963f-75e78b44ac0c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:30.938033 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-b4970d7d-59df-4807-bcaf-03c59b1983fe req-d18b05a0-d957-4e64-963f-75e78b44ac0c service nova] Creating event network-changed:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:54:30.943395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-b4970d7d-59df-4807-bcaf-03c59b1983fe req-d18b05a0-d957-4e64-963f-75e78b44ac0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038561 Jul 12 18:54:30.944419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 278/625] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:54:31.717127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:31.717748 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:31.724781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:31.725230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:31.725977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:31.726402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:31.863090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:31.871668 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:31.873168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:31.874266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5f467505-0d04-42a9-9216-c4ac68abf65f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.161272 Jul 12 18:54:31.874820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 348/626] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:31 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:32.893682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:32.894382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:32.901385 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:32.901834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:32.902597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:32.903120 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:33.032657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:33.041492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:33.043015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:33.044164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e5afea57-d41a-4f30-9b16-79264dbf2ac8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.155412 Jul 12 18:54:33.044833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 279/627] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:32 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:34.063088 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:34.063733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:34.070432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:34.071532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:34.072314 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:34.072747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:34.202445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:34.210364 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:34.212106 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:34.213092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3a740a25-3942-4734-bfa0-d97e39a2ba3d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.154333 Jul 12 18:54:34.213647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 349/628] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:34 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:35.230709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:35.235291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:35.237938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:35.238373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:35.239132 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:35.239592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:35.371031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:35.378897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:35.380415 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:35.381506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7fb2e181-be08-4594-a2f1-c9f18bd3fcc4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.155404 Jul 12 18:54:35.382052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 280/629] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:35 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:36.399669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:36.400276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:36.406512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:36.406964 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:36.407766 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:36.408207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:36.544027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:36.552067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:36.553584 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:36.554792 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6cf092cd-508e-4663-a608-5ddbf593d439 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.159181 Jul 12 18:54:36.555454 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 350/630] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:36 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:37.573125 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:37.573736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:37.577341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:37.580882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:37.585716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:37.585716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:37.585716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:37.721689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:37.730463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:37.734711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:37.734711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-29cc01e2-5a88-45d2-bca7-2a0fcb7afa13 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.164979 Jul 12 18:54:37.734711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 281/631] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:37 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:38.751984 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:38.752623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:38.754456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:38.755113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:38.761690 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:38.762139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:38.762898 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:38.763359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:38.897766 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:38.905957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:38.907603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:38.908693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-15b8787e-202d-40fe-be84-90d0f32289dc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.160608 Jul 12 18:54:38.909261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 351/632] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:38 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:39.113715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-e8b9023a-4724-4b73-bde1-63303df2f090 req-8ab0befd-b052-4f15-8804-b0c755889dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:39.122992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-e8b9023a-4724-4b73-bde1-63303df2f090 req-8ab0befd-b052-4f15-8804-b0c755889dc6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:39.123822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-e8b9023a-4724-4b73-bde1-63303df2f090 req-8ab0befd-b052-4f15-8804-b0c755889dc6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:39.125943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=71 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:54:39.135333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-e8b9023a-4724-4b73-bde1-63303df2f090 req-8ab0befd-b052-4f15-8804-b0c755889dc6 service nova] Creating event network-vif-plugged:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:54:39.140267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-e8b9023a-4724-4b73-bde1-63303df2f090 req-8ab0befd-b052-4f15-8804-b0c755889dc6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083427 Jul 12 18:54:39.140832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 282/633] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:54:39.926170 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:39.926770 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:39.933467 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:39.938421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:39.938421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:39.938421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:40.066752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:40.076181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:40.077691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:40.078867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-542ab81a-5e7a-4a33-a604-86fce8ffea7f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.156666 Jul 12 18:54:40.079487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 352/634] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:39 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:41.099390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:41.100082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:41.106926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:41.107401 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:41.108214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:41.108584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:41.246338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:41.255001 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:41.256676 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:41.257811 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4941707a-d6cb-4f32-a044-e84ef1bca33d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1406 microversion: 2.20 time: 0.163648 Jul 12 18:54:41.258634 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 283/635] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:41 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:42.277152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:42.277806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:42.284315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:42.284769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:42.285536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:42.285968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:42.411582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:42.420109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:42.421606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:54:42.422744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dd462651-56ec-4416-9196-9c0105e5ccce tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1598 microversion: 2.20 time: 0.149731 Jul 12 18:54:42.423295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 353/636] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:54:42 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1598 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:54:42.440772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:54:42.441310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:54:42.447458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:42.447908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:42.448673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:42.449106 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:42.528287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9873d642-eb8c-4f8f-a935-ae9f61b65717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091290 Jul 12 18:54:42.528820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 284/637] 10.222.0.59 () {60 vars in 1315 bytes} [Tue Jul 12 18:54:42 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:54:43.923262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-510f8f98-8285-4ae3-b5c0-6c46d4b98bdf req-71c2f512-9f10-49a1-a2e4-235f471a92f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:54:43.932043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-510f8f98-8285-4ae3-b5c0-6c46d4b98bdf req-71c2f512-9f10-49a1-a2e4-235f471a92f7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:54:43.932472 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-510f8f98-8285-4ae3-b5c0-6c46d4b98bdf req-71c2f512-9f10-49a1-a2e4-235f471a92f7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:54:43.943677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-510f8f98-8285-4ae3-b5c0-6c46d4b98bdf req-71c2f512-9f10-49a1-a2e4-235f471a92f7 service nova] Creating event network-changed:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:54:43.949650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-510f8f98-8285-4ae3-b5c0-6c46d4b98bdf req-71c2f512-9f10-49a1-a2e4-235f471a92f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214818 Jul 12 18:54:43.950459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 354/638] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:01.991623 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:01.992388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=11 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:01.996975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7429349-9760-4220-a25e-832ed7e677b7"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:01.998048 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:02.004077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:02.004528 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:02.005293 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:02.005732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:02.938240 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8eec28c1-4635-4f86-bf55-9e5730fc284a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947870 Jul 12 18:55:02.938800 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 285/639] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:55:01 2022] POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 194 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:03.138165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:03.138934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=38 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:03.142988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:03.144013 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:03.150370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.150819 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.151649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.152078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.181805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-18e87226-8858-4e75-a182-ff7cd1a07952 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044622 Jul 12 18:55:03.186077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 355/640] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:55:03 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:55:03.240284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:03.244206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:03.247793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.248236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.248982 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.249429 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.273728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:55:03.590897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-37881a8d-9d99-497b-986a-bad144202fff tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 204 len: 0 microversion: 2.1 time: 0.354625 Jul 12 18:55:03.591514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 286/641] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:55:03 2022] DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:55:03.600013 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:03.600612 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:03.607485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.607928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.608674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:03.609101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:03.740821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:03.748864 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-222aa8a6-ecb1-4950-869a-49f77e0c7372 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1674 microversion: 2.1 time: 0.152982 Jul 12 18:55:03.749420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 356/642] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:03 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:04.766750 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:04.767491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:04.773868 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:04.774309 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:04.775907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:04.776340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:04.902670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:04.910062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-055578ac-9502-484f-b00a-512a752c4dc3 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1674 microversion: 2.1 time: 0.147574 Jul 12 18:55:04.910618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 287/643] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:04 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:05.927202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:05.929868 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:05.936910 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:05.937444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:05.938446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:05.938948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:06.010533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:06.017954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d477e641-6f11-4fcd-84fc-d7b072234625 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1606 microversion: 2.1 time: 0.094821 Jul 12 18:55:06.018531 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 357/644] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:05 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:06.122902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-b47f78db-1883-43dd-b093-c9164664e2d9 req-abb64056-10c5-4236-a320-ae22b6b69f25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79956b08-375e-45c0-8616-a59bdbe15dea", "name": "network-vif-deleted", "tag": "be33f777-fc8d-432e-ab16-15bec479526a"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:06.131533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b47f78db-1883-43dd-b093-c9164664e2d9 req-abb64056-10c5-4236-a320-ae22b6b69f25 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:06.134561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b47f78db-1883-43dd-b093-c9164664e2d9 req-abb64056-10c5-4236-a320-ae22b6b69f25 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:06.143732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-b47f78db-1883-43dd-b093-c9164664e2d9 req-abb64056-10c5-4236-a320-ae22b6b69f25 service nova] Creating event network-vif-deleted:be33f777-fc8d-432e-ab16-15bec479526a for instance 79956b08-375e-45c0-8616-a59bdbe15dea on hv-cinder-83538 Jul 12 18:55:06.148713 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-b47f78db-1883-43dd-b093-c9164664e2d9 req-abb64056-10c5-4236-a320-ae22b6b69f25 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029521 Jul 12 18:55:06.149533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 288/645] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:07.036387 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:07.036993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:07.044058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:07.044498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:07.045351 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:07.045797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:07.078542 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:07.079021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:07.079496 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lazy-loading 'fault' on Instance uuid 79956b08-375e-45c0-8616-a59bdbe15dea {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:55:07.126490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:07.135490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bec77b09-aea2-4365-b8a5-907c3f3b81fb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 200 len: 1326 microversion: 2.1 time: 0.102848 Jul 12 18:55:07.136115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 358/646] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:07 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:08.154860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:08.155503 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:08.161715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:08.162166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:08.162928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:08.163396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:08.176454 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea HTTP/1.1 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:55:08.178069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:55:08.179679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '79956b08-375e-45c0-8616-a59bdbe15dea'} Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:55:08.181380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:55:08.182885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:08.184391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:55:08.184391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7f2df0aa-ab63-4a9f-a682-d5c92d57ae0a tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 404 len: 111 microversion: 2.1 time: 0.029683 Jul 12 18:55:08.184391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 289/647] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:08 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:55:08.188931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3b3e7e59-fb0b-4d79-a70b-db1fef4f738e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '.version_select at 0x7f017847a670>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:08.293540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3b3e7e59-fb0b-4d79-a70b-db1fef4f738e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-82221613" status: 202 len: 0 microversion: 2.1 time: 0.108277 Jul 12 18:55:08.294133 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 359/648] 10.222.0.59 () {58 vars in 1214 bytes} [Tue Jul 12 18:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-82221613 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:55:09.038984 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b5a52b3e-5b34-414b-b55a-367f68a460d4 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: .version_select at 0x7f01782f55e0>, body: {"keypair": {"name": "tempest-keypair-134881367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+A11/I1R9Ey+9vwCmvO7YW6W/Zmg26AnmpZdLFntKHLDUdpS/wbLFc7T3t85P/cPecJMemBQYe3g7REoPxCigkUuacj9ALDLpJ/TggURtzPeUYdtcmVcUx274HxTBFFA=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:09.053270 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-b5a52b3e-5b34-414b-b55a-367f68a460d4 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for project 2b14300d453444a582d224fcee029d2d. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:55:09.057229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-b5a52b3e-5b34-414b-b55a-367f68a460d4 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for user 26993e3a077449da9c71fa7f1023a1e7 and project 2b14300d453444a582d224fcee029d2d. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:55:09.133292 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b5a52b3e-5b34-414b-b55a-367f68a460d4 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.098144 Jul 12 18:55:09.134401 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 290/649] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:55:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:11.490096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:11.491036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:11.498419 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:11.498876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:11.499687 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:11.500121 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:11.523895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'flavor' on Instance uuid ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:55:11.537581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1549178215", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73f2462e-063e-48c5-a19d-1d4dfbc64d32"}], "security_groups": [{"name": "tempest-securitygroup--1637297891"}], "key_name": "tempest-keypair-134881367", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:11.644984 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] validate_networks() for [('73f2462e-063e-48c5-a19d-1d4dfbc64d32', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:55:11.920080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-adfa2961-85fc-49d4-88ec-658a98220190 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/action" status: 200 len: 32 microversion: 2.1 time: 0.433846 Jul 12 18:55:11.920808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 360/650] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:55:11 2022] POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:55:11.931401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:11.932208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:11.939139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:11.939744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:11.940607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:11.941102 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:12.179233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:12.187881 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dcd4b466-6fc6-4a8e-87cb-423b5f17e793 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.261557 Jul 12 18:55:12.188912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 361/651] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:11 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:12.206738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:55:12.207154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:55:12.207642 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:55:12.208181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:55:12.208586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:55:12.218309 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:12.218743 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:12.219562 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:12.219990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:12.236329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for project 2b14300d453444a582d224fcee029d2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:55:12.240180 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Getting quotas for user 26993e3a077449da9c71fa7f1023a1e7 and project 2b14300d453444a582d224fcee029d2d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:55:12.251328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:55:12.253579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:55:12.428535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b19de628-0f25-4e2e-8366-00272b01bb90 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.895276 Jul 12 18:55:12.429341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 291/652] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:55:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:55:12.439247 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e44125f0-6e8e-4a34-8f5c-2caffd30f6c9 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:12.439993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e44125f0-6e8e-4a34-8f5c-2caffd30f6c9 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:12.512773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e44125f0-6e8e-4a34-8f5c-2caffd30f6c9 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:12.520751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e44125f0-6e8e-4a34-8f5c-2caffd30f6c9 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1237 microversion: 2.1 time: 0.085225 Jul 12 18:55:12.521263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 362/653] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:12 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1237 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:13.206467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:13.207034 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:13.214703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:13.215201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:13.216012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:13.216452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:13.346736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:13.355422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3b99b372-fdb8-4fc9-a700-70309879b8d7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.153037 Jul 12 18:55:13.356200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 292/654] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:13 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:13.541034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:13.541644 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:13.548838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:13.549278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:13.550030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:13.550452 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:13.610038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:13.617585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-944e6898-f0f9-492a-afcc-f4051510191c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1233 microversion: 2.1 time: 0.080967 Jul 12 18:55:13.618222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 363/655] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:13 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1233 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:14.484556 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:14.485174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:14.491390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:14.491840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:14.492595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:14.493030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:14.637533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:14.638183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:14.650383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:14.654781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:14.655556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:14.656109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:14.656540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:14.658772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3e093b1b-d3ec-4ffd-862b-9c3afcd3a4a5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.289432 Jul 12 18:55:14.659486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 293/656] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:14 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:14.738269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:14.750120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-80d9963b-bc43-4585-a192-ad35a0fa3a14 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1307 microversion: 2.1 time: 0.117344 Jul 12 18:55:14.750874 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 364/657] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:14 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:15.676978 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:15.677585 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:15.684438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.684885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.685646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.686076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.774122 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:15.775312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:15.783142 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.783646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.784589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.785027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.882067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:15.892770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-538c1346-09ac-40a1-a827-c341b25b9aa9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.219336 Jul 12 18:55:15.905619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 294/658] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:15 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:15.913219 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-611113077"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:15.913963 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:15.925831 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.925831 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.926634 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:15.927071 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:15.957992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:15.967715 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ed24f570-061a-4312-b7f0-5903ce3f91bc tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.197411 Jul 12 18:55:15.968524 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 365/659] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:15 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:16.075779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.network.security_group_api [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Removing security group c8f09959-9492-4923-b884-b857da6d5806 from port 7f28e2f1-1a45-4459-ba5e-970f577313a1 Jul 12 18:55:16.164931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-c9945696-d4a6-4469-841c-d39e6731ec30 req-eb7f75c7-f833-4864-9168-938b290fc1d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811f414f-708a-4313-9909-6c6c4eaba7cd", "tag": "b87fdb7e-c917-4f1e-88a0-c74afb7755d8"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:16.177696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-c9945696-d4a6-4469-841c-d39e6731ec30 req-eb7f75c7-f833-4864-9168-938b290fc1d3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:16.178143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-c9945696-d4a6-4469-841c-d39e6731ec30 req-eb7f75c7-f833-4864-9168-938b290fc1d3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:16.193547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-c9945696-d4a6-4469-841c-d39e6731ec30 req-eb7f75c7-f833-4864-9168-938b290fc1d3 service nova] Creating event network-changed:b87fdb7e-c917-4f1e-88a0-c74afb7755d8 for instance 811f414f-708a-4313-9909-6c6c4eaba7cd on hv-cinder-83538 Jul 12 18:55:16.199767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-c9945696-d4a6-4469-841c-d39e6731ec30 req-eb7f75c7-f833-4864-9168-938b290fc1d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038211 Jul 12 18:55:16.201075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 366/660] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:55:16.513941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-143b8bff-cbd8-44f9-8600-7bfc3b7a95c3 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action" status: 202 len: 0 microversion: 2.1 time: 0.606211 Jul 12 18:55:16.514555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 295/661] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:55:15 2022] POST /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:55:16.525422 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-ca961276-2367-4bb1-93b5-a6b82beeccba req-f957a566-b463-4482-8c6e-aa44c7ff34bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:16.537739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ca961276-2367-4bb1-93b5-a6b82beeccba req-f957a566-b463-4482-8c6e-aa44c7ff34bd service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:16.538182 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ca961276-2367-4bb1-93b5-a6b82beeccba req-f957a566-b463-4482-8c6e-aa44c7ff34bd service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:16.560876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-ca961276-2367-4bb1-93b5-a6b82beeccba req-f957a566-b463-4482-8c6e-aa44c7ff34bd service nova] Creating event network-changed:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:55:16.571944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-ca961276-2367-4bb1-93b5-a6b82beeccba req-f957a566-b463-4482-8c6e-aa44c7ff34bd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054954 Jul 12 18:55:16.573063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 367/662] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:16.914891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:16.916639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:16.931337 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:16.931794 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:16.933340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:16.933783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:16.990099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:16.994130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:17.007380 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:17.011189 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:17.012147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:17.012674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:17.252462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:17.262815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-00bddc36-7a1d-42c8-9bf5-b5222bcc6601 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.355486 Jul 12 18:55:17.263773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 296/663] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:16 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:17.277719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:17.286003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3af95780-b912-4239-89c3-974b7f5d396e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.304063 Jul 12 18:55:17.286583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 368/664] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:16 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:18.178241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:18.178738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:18.185749 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.186545 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.187111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.187577 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.220255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-12e47759-45cf-45f9-a68c-d071656250a3 req-81fc3117-121e-4cbb-8889-66c383f2c697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:18.228699 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-12e47759-45cf-45f9-a68c-d071656250a3 req-81fc3117-121e-4cbb-8889-66c383f2c697 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.229661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-12e47759-45cf-45f9-a68c-d071656250a3 req-81fc3117-121e-4cbb-8889-66c383f2c697 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.240551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-12e47759-45cf-45f9-a68c-d071656250a3 req-81fc3117-121e-4cbb-8889-66c383f2c697 service nova] Creating event network-changed:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:55:18.246055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-12e47759-45cf-45f9-a68c-d071656250a3 req-81fc3117-121e-4cbb-8889-66c383f2c697 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031794 Jul 12 18:55:18.246686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 369/665] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:18.272521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lazy-loading 'services' on Instance uuid 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:55:18.282202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:18.282993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:18.289336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.289915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.290775 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.292004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.435081 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:18.444009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2f70f230-4adb-4c88-9a16-1a9246156958 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.166459 Jul 12 18:55:18.444585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 370/666] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:18 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:18.449307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:18.449914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:18.455955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.456406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.457182 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.457621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.494854 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-36382532-d45e-4a19-a04f-e82f9a5eddeb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments/6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6" status: 202 len: 0 microversion: 2.1 time: 0.320579 Jul 12 18:55:18.495836 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 297/667] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:55:18 2022] DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments/6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:55:18.504661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:18.506386 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:18.513879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.514624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.516755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:18.517846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:18.554154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e62f187c-8981-466f-93d4-206748a7980b tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053685 Jul 12 18:55:18.554975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 298/668] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:55:18 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:18.617533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:18.625345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2a75677f-31b8-4b3a-bc60-3df1863f6b42 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.179613 Jul 12 18:55:18.626249 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 371/669] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:18 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:19.461793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:19.462308 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:19.468974 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.469424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.470181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.470615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.566135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:19.567067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:19.573622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.574065 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.574831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.575262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.601554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:19.605886 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-936a6ba2-6020-4d70-8e4e-fa04e6831229 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Jul 12 18:55:19.606461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 372/670] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:55:19 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:55:19.610120 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-93497752-14bc-4c5a-985c-81d59ade7176 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.152250 Jul 12 18:55:19.610725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 299/671] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:19 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:19.641764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:19.642369 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:19.648384 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.648832 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.649635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:19.650070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:19.654240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:19.869772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:19.878093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eaf50c2c-e07a-4845-b253-7ac86f82a38e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.240110 Jul 12 18:55:19.878664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 373/672] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:19 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:20.616898 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:20.617957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:20.625170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.625621 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.626380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.626809 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.627763 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:20.628442 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:20.635415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.635869 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.636627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.637060 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.656440 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-34b2b9ca-8e53-476f-adb3-c41f001f202e tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043525 Jul 12 18:55:20.657008 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 300/673] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:55:20 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:20.765807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:20.773937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d058e98c-233e-4808-a003-6fc2bce7970a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.150001 Jul 12 18:55:20.775445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 374/674] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:20 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:20.896080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:20.896682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:20.903323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.903769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.904521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:20.904951 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:20.909075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:21.045491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:21.052647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3e2e5dd3-4ccd-484c-b985-0664fc68b501 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.160515 Jul 12 18:55:21.053202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 301/675] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:20 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:21.668481 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:21.669420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:21.675876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.676321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.677088 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.677505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.706431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d6bfc372-fc00-4f0e-8b60-2f15975775eb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042191 Jul 12 18:55:21.707000 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 375/676] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:55:21 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:55:21.717235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:21.717788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:21.724404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.724861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.725631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.726070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.792136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:21.792768 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:21.799084 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.799569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.800335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:21.800821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:21.806205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] HTTP exception thrown: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 is not attached to volume 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Request method failure captured: Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments/6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 HTTP/1.1 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcJ1DfZkpiZYW8Olg8dRMnJ1JGC0iDJoFOlccFRpt00CoXA6F79PEsnpe8zA_FT1IEkMnBAi1dCKsW7kAjXQb6T5Dw__AbmWRf-OZbuysPlCHTb1mMmiEsHkRF63a1RmzS2FYSt9waJup-A9Xe3yV14SJ29Msw_tjFqfW0Oljm9DCMQ Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 173966e9a1ae48f88fd80f82c81f1079 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:55:21.808241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_173966e9a1ae48f88fd80f82c81f1079", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 173966e9a1ae48f88fd80f82c81f1079 Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestMinimumBasicScenario-1439491642-project Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: fac20f65ef844175927f0b7ea9fd14b9 Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestMinimumBasicScenario-1439491642-project Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:55:21.809607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 is not attached to volume 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'server_id': '07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6', 'id': '6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6'} Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6. Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:55:21.810313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 is not attached to volume 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 is not attached to volume 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:21.811487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Returning 404 to user: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 is not attached to volume 6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:55:21.812425 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3df2d804-88bd-47e9-a801-fdba65c2aff0 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments/6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6" status: 404 len: 154 microversion: 2.1 time: 0.096931 Jul 12 18:55:21.812425 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 302/677] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:55:21 2022] DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6/os-volume_attachments/6a5ea7de-3a02-445b-a5c4-59cb94ccd8a6 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:55:21.941431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:21.949356 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-32cf132d-a0e8-4257-b0fb-490cfed562a3 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.161583 Jul 12 18:55:21.949917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 376/678] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:21 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:22.069636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:22.070236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:22.076401 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:22.076846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:22.077819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:22.078250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:22.206946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:22.214798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-406a6207-346a-41b1-ba57-c4afab3757e2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.149010 Jul 12 18:55:22.215365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 303/679] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:22 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:22.966203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:22.966843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:22.968716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:22.974050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:22.974497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:22.975380 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:22.975760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.057374 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:23.057912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:23.061023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:23.061695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=10 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:23.067142 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.067628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.068414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.069280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.096384 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:55:23.109317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:23.117842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d3b6dc51-adc2-4895-b3ad-40a6788ad750 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.155679 Jul 12 18:55:23.123350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 377/680] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:22 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:23.231938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:23.232675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:23.238491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.238940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.239735 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.240169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.345042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-942fb828-668a-4797-ae60-dea1b90fff68 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 204 len: 0 microversion: 2.1 time: 0.291402 Jul 12 18:55:23.345772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 304/681] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:55:23 2022] DELETE /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:55:23.351144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-da97b0ae-52f6-4d97-9937-98aff86a345a req-a8dbf9c2-99d1-4f8a-97c9-9f1d0202b324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f414f-708a-4313-9909-6c6c4eaba7cd", "name": "network-vif-plugged", "status": "completed", "tag": "b87fdb7e-c917-4f1e-88a0-c74afb7755d8"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:23.360083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-da97b0ae-52f6-4d97-9937-98aff86a345a req-a8dbf9c2-99d1-4f8a-97c9-9f1d0202b324 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.360530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-da97b0ae-52f6-4d97-9937-98aff86a345a req-a8dbf9c2-99d1-4f8a-97c9-9f1d0202b324 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.372337 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-da97b0ae-52f6-4d97-9937-98aff86a345a req-a8dbf9c2-99d1-4f8a-97c9-9f1d0202b324 service nova] Creating event network-vif-plugged:b87fdb7e-c917-4f1e-88a0-c74afb7755d8 for instance 811f414f-708a-4313-9909-6c6c4eaba7cd on hv-cinder-83538 Jul 12 18:55:23.377059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-da97b0ae-52f6-4d97-9937-98aff86a345a req-a8dbf9c2-99d1-4f8a-97c9-9f1d0202b324 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029913 Jul 12 18:55:23.380409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 305/682] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:23.381757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:23.382783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:23.383512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:23.389975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.390147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d9b1fd5b-c441-469f-9952-55afdbeebc97 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.162394 Jul 12 18:55:23.390426 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.390701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 378/683] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:23 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:23.391272 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:23.391824 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:23.525117 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:23.532904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8cb3577a-3208-4d5f-97de-4647fa3d5eb9 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1554 microversion: 2.1 time: 0.154170 Jul 12 18:55:23.533475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 306/684] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:23 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:24.136101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:24.137345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:24.143991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.144443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.145228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.145664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.270988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:24.279592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ba539071-568c-4e6b-bdf9-646d9f9e2047 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.147538 Jul 12 18:55:24.280154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 379/685] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:24 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:24.407374 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:24.407990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:24.414402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.427050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.427050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.427050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.550107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:24.551006 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:24.557205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.557855 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.559335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:24.559921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:24.584708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:24.593424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2cb2f31b-a085-42b2-9d6c-329995f30131 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.189955 Jul 12 18:55:24.594351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 307/686] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:24 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:24.706921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:24.716773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-405c3c9d-ee8e-4a5c-a22a-427df33e8ffb tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1554 microversion: 2.1 time: 0.170353 Jul 12 18:55:24.717573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 380/687] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:24 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:25.297399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:25.298107 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:25.304886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.305417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.306257 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.306766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.444338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:25.453441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-91ef3a47-c2d9-4a3c-a637-48fb4081b270 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.160537 Jul 12 18:55:25.454011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 308/688] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:25 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:25.611048 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:25.611741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:25.618664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.619120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.619945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.620382 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.734644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:25.737265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:25.741567 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.742020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.742863 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:25.743324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:25.753917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:25.761764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-607d427b-4b14-4158-a282-92d3ea1895c0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.155556 Jul 12 18:55:25.762339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 381/689] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:25 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:25.872066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:25.880400 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b74e04b3-86a2-4288-a441-aa0c45ce0e5a tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1554 microversion: 2.1 time: 0.150376 Jul 12 18:55:25.880955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 309/690] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:25 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:26.471148 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:26.471788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:26.477749 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.478199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.478955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.479431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.605978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:26.614001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c8e9c5fc-a8f1-430a-8d80-e66a430f0792 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.147973 Jul 12 18:55:26.614593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 382/691] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:26 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:26.778796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:26.779347 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:26.785947 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.786397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.787152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.787620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.897459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:26.898085 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:26.904602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.905045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.905806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:26.906236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:26.983682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:26.991208 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cf6f3de5-1baa-4245-a0e7-48cd5a09494b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1363 microversion: 2.1 time: 0.216331 Jul 12 18:55:26.991795 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 310/692] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:26 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:27.118255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:27.126373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c315289b-cb88-4b7c-9636-5e7ffeb09d2d tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1554 microversion: 2.1 time: 0.232810 Jul 12 18:55:27.126948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 383/693] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:26 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:27.529243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-185f2230-e010-4cd7-87f1-6d0a43e335b7 req-d5d735d2-b836-4dc4-ab39-898974d662af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6", "name": "network-vif-deleted", "tag": "7f28e2f1-1a45-4459-ba5e-970f577313a1"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:27.537521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-185f2230-e010-4cd7-87f1-6d0a43e335b7 req-d5d735d2-b836-4dc4-ab39-898974d662af service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:27.537966 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-185f2230-e010-4cd7-87f1-6d0a43e335b7 req-d5d735d2-b836-4dc4-ab39-898974d662af service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:27.549030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-185f2230-e010-4cd7-87f1-6d0a43e335b7 req-d5d735d2-b836-4dc4-ab39-898974d662af service nova] Creating event network-vif-deleted:7f28e2f1-1a45-4459-ba5e-970f577313a1 for instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 on hv-cinder-83538 Jul 12 18:55:27.553816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-185f2230-e010-4cd7-87f1-6d0a43e335b7 req-d5d735d2-b836-4dc4-ab39-898974d662af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028823 Jul 12 18:55:27.554388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 311/694] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:27.632320 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:27.633023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:27.639988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:27.640431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:27.641181 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:27.641612 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:27.774091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:27.782987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c9b6b563-7a50-4a13-8c3d-4235d732d840 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.154544 Jul 12 18:55:27.783600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 384/695] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:27 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:28.010164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:28.010779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:28.017243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.017683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.018432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.018861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.143666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:28.144368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:28.151042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.151536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.152308 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.152746 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.157043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:28.164596 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f6b631c3-2ed4-48b7-aaa0-6aabee512811 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1550 microversion: 2.1 time: 0.159468 Jul 12 18:55:28.167206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 312/696] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:28 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:28.181992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:28.182534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:28.185482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.185916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.186396 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lazy-loading 'fault' on Instance uuid 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:55:28.189741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.190260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.191030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.191492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.230959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac20f65ef844175927f0b7ea9fd14b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '173966e9a1ae48f88fd80f82c81f1079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:28.239213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e400405d-c289-4d8d-919a-945e1d2aedc5 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 200 len: 1348 microversion: 2.1 time: 0.099428 Jul 12 18:55:28.239824 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 385/697] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:28 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:28.275324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bf952afb-fef0-4655-88de-bf830d715611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097128 Jul 12 18:55:28.275929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 313/698] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 18:55:28 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:28.800515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:28.801361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:28.807706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.808151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:28.808934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:28.809347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:29.068556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:29.077371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-23ea3971-8d3b-4ff9-9818-dee0847570f4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.280807 Jul 12 18:55:29.077948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 386/699] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:28 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:29.257000 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:29.257614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] [instance: 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:29.264237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:29.264697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:29.265501 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:29.265943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:29.279633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] HTTP exception thrown: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Request method failure captured: Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 HTTP/1.1 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcJ1DfZkpiZYW8Olg8dRMnJ1JGC0iDJoFOlccFRpt00CoXA6F79PEsnpe8zA_FT1IEkMnBAi1dCKsW7kAjXQb6T5Dw__AbmWRf-OZbuysPlCHTb1mMmiEsHkRF63a1RmzS2FYSt9waJup-A9Xe3yV14SJ29Msw_tjFqfW0Oljm9DCMQ Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 173966e9a1ae48f88fd80f82c81f1079 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:55:29.281280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_173966e9a1ae48f88fd80f82c81f1079", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/173966e9a1ae48f88fd80f82c81f1079"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 173966e9a1ae48f88fd80f82c81f1079 Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1439491642 Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestMinimumBasicScenario-1439491642-project Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: fac20f65ef844175927f0b7ea9fd14b9 Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestMinimumBasicScenario-1439491642-project Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. Jul 12 18:55:29.282867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6'} Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:55:29.283816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. Jul 12 18:55:29.285236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:55:29.286510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Returning 404 to user: Instance 07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:55:29.286510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c2900498-2859-49ee-b8e9-f49f179cbe25 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6" status: 404 len: 111 microversion: 2.1 time: 0.030187 Jul 12 18:55:29.286510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 314/700] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:29 2022] GET /compute/v2.1/servers/07cd0188-99f1-4fb8-bdd4-3fa4f98b3ee6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:55:29.291500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-050e7a97-53f0-4d03-91ae-031caa8c0070 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] Calling method '.version_select at 0x7f01784aeca0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:29.373647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-050e7a97-53f0-4d03-91ae-031caa8c0070 tempest-TestMinimumBasicScenario-1439491642 tempest-TestMinimumBasicScenario-1439491642-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-949100624" status: 202 len: 0 microversion: 2.1 time: 0.086029 Jul 12 18:55:29.374240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 387/701] 10.222.0.59 () {58 vars in 1268 bytes} [Tue Jul 12 18:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-949100624 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:55:29.568456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-168d7ac9-72e4-460c-80e5-396cdc8bda8a req-3e14b7c7-0cd3-4fe8-b7cf-ce5fba455095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811f414f-708a-4313-9909-6c6c4eaba7cd", "tag": "b87fdb7e-c917-4f1e-88a0-c74afb7755d8"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:29.573416 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:29.578056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-168d7ac9-72e4-460c-80e5-396cdc8bda8a req-3e14b7c7-0cd3-4fe8-b7cf-ce5fba455095 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:29.578512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-168d7ac9-72e4-460c-80e5-396cdc8bda8a req-3e14b7c7-0cd3-4fe8-b7cf-ce5fba455095 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:29.590465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-168d7ac9-72e4-460c-80e5-396cdc8bda8a req-3e14b7c7-0cd3-4fe8-b7cf-ce5fba455095 service nova] Creating event network-changed:b87fdb7e-c917-4f1e-88a0-c74afb7755d8 for instance 811f414f-708a-4313-9909-6c6c4eaba7cd on hv-cinder-83538 Jul 12 18:55:29.596484 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-168d7ac9-72e4-460c-80e5-396cdc8bda8a req-3e14b7c7-0cd3-4fe8-b7cf-ce5fba455095 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031601 Jul 12 18:55:29.597090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 315/702] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:30.094809 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:30.095456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:30.101590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:30.102868 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:30.103676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:30.104263 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:30.259233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:30.269278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5a916429-0649-4784-b47b-643d26aa27e9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.179012 Jul 12 18:55:30.269957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 388/703] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:30 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:31.288638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:31.289447 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:31.296900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:31.297435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:31.298206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:31.298634 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:31.495869 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:31.504105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-64cfa284-1ab7-48ee-ba97-eabfa83c1dfa tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.220582 Jul 12 18:55:31.504678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 316/704] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:31 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:32.522359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:32.522988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:32.529969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:32.530415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:32.531177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:32.531646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:32.770747 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:32.780124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-39344fad-fc0e-498e-aab1-e8457878ab7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.261419 Jul 12 18:55:32.780720 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 389/705] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:32 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:33.797693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:33.798583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:33.806169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:33.806950 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:33.807996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:33.808628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:34.213514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:34.222638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-93afa8c8-1d13-4805-bc32-3cb0a20a0dfb tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.428957 Jul 12 18:55:34.233804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 317/706] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:33 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:35.240274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:35.240879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:35.243348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:35.248372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:35.248810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:35.249570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:35.249991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:35.268849 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:35.381153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:35.390131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d459ff8f-c4a8-47a7-92d7-c4829d0bae7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1736 microversion: 2.1 time: 0.153671 Jul 12 18:55:35.390702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 390/707] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:35 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:36.408073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:36.409229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:36.415998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.416306 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.417076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.417502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.559004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:36.569232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-aecefe93-002f-4e11-9775-298ec8336b7b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1716 microversion: 2.1 time: 0.165749 Jul 12 18:55:36.570469 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 318/708] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:36 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:36.637259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:36.637922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:36.645996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.646433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.647197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.647659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.729828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] HTTP exception thrown: Cannot 'detach_volume' instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 while it is in vm_state rescued Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Request method failure captured: Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments/f7429349-9760-4220-a25e-832ed7e677b7 HTTP/1.1 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcJmcmVtXABsamAjtF1ISXeDG2KdSyduJ1o4ZF-tgxw6vBX6aKS0Kj3uhpoAmzqeaGJYUNHwdbXNveA-rMN8BCQeDzyQhgCbg3BLWAk14wyK9fc3hyNvxj2wAi-DAYto84xToWz0NHPfjhOT2A0HrjxkSLvJwz1T2nNMorPMUP2wnY0 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:55:36.731510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eb4f266e82834cc7930a4e60343660c9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 56363156a2b046fca40df895b3f6a050 Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:55:36.734131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Cannot 'detach_volume' instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 while it is in vm_state rescued Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'server_id': 'ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7', 'id': 'f7429349-9760-4220-a25e-832ed7e677b7'} Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:55:36.734912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 while it is in vm_state rescued Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 while it is in vm_state rescued Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:55:36.737355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Returning 409 to user: Cannot 'detach_volume' instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 while it is in vm_state rescued {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:55:36.739150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fc9af2cc-aa9c-4fb4-a408-d9d330222198 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments/f7429349-9760-4220-a25e-832ed7e677b7" status: 409 len: 152 microversion: 2.1 time: 0.101094 Jul 12 18:55:36.739150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 391/709] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:55:36 2022] DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments/f7429349-9760-4220-a25e-832ed7e677b7 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 12 18:55:36.742404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:36.742929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:36.749419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.749864 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.750625 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.751049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.754851 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:36.969831 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7116e9ba-8fb6-4656-a841-6a51a7bcf19a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/action" status: 202 len: 0 microversion: 2.1 time: 0.231048 Jul 12 18:55:36.970531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 319/710] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 18:55:36 2022] POST /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:55:36.979555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:36.980500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:36.989276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.989755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:36.990535 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:36.990977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:37.162679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:37.172336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4f5e1d34-4c57-4f49-b2fe-eb588cdb6529 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1724 microversion: 2.1 time: 0.197386 Jul 12 18:55:37.173035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 392/711] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:36 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:38.192115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:38.192819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:38.199687 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:38.200143 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:38.202512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:38.202512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:38.340891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:38.348795 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-32b9a61d-94b2-4fc3-a7ec-0955284c209d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1724 microversion: 2.1 time: 0.161981 Jul 12 18:55:38.351636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 320/712] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:38 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:55:39.365962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:39.366568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:39.373832 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:39.374280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:39.375038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:39.375497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:39.502044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:39.510194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-35de32c0-c3dd-4185-8893-40111a03f3f7 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1724 microversion: 2.1 time: 0.147855 Jul 12 18:55:39.510759 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 393/713] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:39 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:40.528020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:40.528552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:40.535443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:40.535895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:40.536654 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:40.537085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:40.674209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:55:40.682038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7e3b13a2-0b42-401b-a8ef-6d11cda7502d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1730 microversion: 2.1 time: 0.158062 Jul 12 18:55:40.693380 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 321/714] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:55:40 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:55:40.699866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:40.702673 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:40.709391 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:40.709833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:40.711474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:40.711905 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:40.796633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-18206985-5e30-4c8d-87e0-3658eba1a865 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101204 Jul 12 18:55:40.797229 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 394/715] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 18:55:40 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:41.793597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-b959a450-2484-413a-ae35-6fc9ffa0bf28 req-b70225cc-7555-4e17-9e98-0e141eb4e01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:41.803254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b959a450-2484-413a-ae35-6fc9ffa0bf28 req-b70225cc-7555-4e17-9e98-0e141eb4e01d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:41.803791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-b959a450-2484-413a-ae35-6fc9ffa0bf28 req-b70225cc-7555-4e17-9e98-0e141eb4e01d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:41.816020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-b959a450-2484-413a-ae35-6fc9ffa0bf28 req-b70225cc-7555-4e17-9e98-0e141eb4e01d service nova] Creating event network-changed:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:55:41.821038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-b959a450-2484-413a-ae35-6fc9ffa0bf28 req-b70225cc-7555-4e17-9e98-0e141eb4e01d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031227 Jul 12 18:55:41.821706 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 322/716] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:43.836695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-015402b8-69b6-41b7-a854-6c3f051a839a req-36c3fe56-0c66-4f1b-889c-bfbd9192efd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:43.845949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-015402b8-69b6-41b7-a854-6c3f051a839a req-36c3fe56-0c66-4f1b-889c-bfbd9192efd9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:43.846390 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-015402b8-69b6-41b7-a854-6c3f051a839a req-36c3fe56-0c66-4f1b-889c-bfbd9192efd9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:43.858830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-015402b8-69b6-41b7-a854-6c3f051a839a req-36c3fe56-0c66-4f1b-889c-bfbd9192efd9 service nova] Creating event network-changed:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:55:43.864127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-015402b8-69b6-41b7-a854-6c3f051a839a req-36c3fe56-0c66-4f1b-889c-bfbd9192efd9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031758 Jul 12 18:55:43.865157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 395/717] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:53.547694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=14 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:53.548458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:53.777350 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-064b3919-19ef-46ff-b61b-75f744d3dd56 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Action: 'create', calling method: .version_select at 0x7f01782ebf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1163641014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIqoGFwih0orZ/x44bJJbTvlGDxmXdWIUok2Urd8Bxu2r9MdrWwiPj8ybICEwjSTDqU8vtTOu9yeNSqNzm2ccCr3xRevf55TIsU11WRYesZjYVDE7NYNnbCkaywwUhuCg=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:55:53.791504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-064b3919-19ef-46ff-b61b-75f744d3dd56 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for project 0f20a43af9cc4c68904ba717560e3789. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:55:53.795275 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-064b3919-19ef-46ff-b61b-75f744d3dd56 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for user 584b15b723a94f8bb380b76a2db97fc8 and project 0f20a43af9cc4c68904ba717560e3789. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:55:53.899029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-064b3919-19ef-46ff-b61b-75f744d3dd56 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.353323 Jul 12 18:55:53.899700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 323/718] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:55:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:55:58.951104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=11 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:58.951870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=26 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:55:58.956335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:55:58.956916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:55:58.962834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:58.963282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:58.965204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:55:58.965204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:55:58.988552 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-06fe6e54-bcaa-47dd-ac11-334b091923ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/ips" status: 200 len: 152 microversion: 2.20 time: 0.038985 Jul 12 18:55:58.989116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 396/719] 10.222.0.59 () {60 vars in 1288 bytes} [Tue Jul 12 18:55:58 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:56:02.764985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:02.765701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:02.772204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:02.772650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:02.773423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:02.773846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:02.797179 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lazy-loading 'flavor' on Instance uuid 1dddcf1b-5875-4418-915d-79802a91a6f3 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:56:03.379405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8255379c-ca6d-4fcc-82eb-7029a0b183f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/action" status: 202 len: 0 microversion: 2.20 time: 0.618861 Jul 12 18:56:03.379963 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 324/720] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Jul 12 18:56:02 2022] POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:56:03.388597 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:03.389205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:03.396876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:03.397325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:03.398086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:03.398517 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:03.530812 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:03.539848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:03.541357 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:03.542507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0157a97d-ab1b-4b0f-b036-8bc79de5e1d6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.158102 Jul 12 18:56:03.543094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 397/721] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:03 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:04.561105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:04.565412 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:04.566113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:04.572444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:04.572896 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:04.573657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:04.574102 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:04.712079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:04.720284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:04.722467 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:04.723788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-992ac662-5050-4cb8-afe1-927e1d978d94 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.164281 Jul 12 18:56:04.724341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 325/722] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:04 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:05.742545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:05.743147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:05.749660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:05.750100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:05.750854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:05.751279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:05.883497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:05.891988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:05.894952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:05.896423 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b3c2cdfa-9744-4c9d-8b29-b0d7eca3eba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.158069 Jul 12 18:56:05.897316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 398/723] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:05 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:06.913924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:06.914534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:06.921043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:06.921496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:06.922259 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:06.922691 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:07.058760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:07.067019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:07.068683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:07.070104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9eac720f-b7d9-4127-9c17-ada849715327 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.160133 Jul 12 18:56:07.070661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 326/724] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:06 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:08.089341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:08.089967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:08.096082 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:08.096523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:08.097668 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:08.098899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:08.229619 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:08.237417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:08.239329 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:08.245469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b3b85616-0e05-49b9-b400-cfce05b79829 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.155133 Jul 12 18:56:08.245469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 399/725] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:08 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:09.265643 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:09.266307 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:09.272816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:09.273263 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:09.274028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:09.274499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:09.403405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:09.412213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:09.413715 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:09.414896 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-070408e7-4c97-48aa-9ce4-314b2b5644cc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.153194 Jul 12 18:56:09.415479 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 327/726] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:09 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:10.433369 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:10.433981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:10.440548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:10.441004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:10.442036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:10.442321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:10.568764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:10.576742 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:10.578251 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:10.579424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e937d156-5a52-458a-969d-9dbfa6d739b1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.150092 Jul 12 18:56:10.579990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 400/727] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:10 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:11.598335 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:11.599069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:11.605482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:11.605926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:11.606680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:11.607115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:11.739451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:11.747727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:11.749221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:11.750366 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8cf913bd-9313-4727-97b0-cdfedadba7f2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.156536 Jul 12 18:56:11.750913 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 328/728] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:11 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:12.768685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:12.769281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:12.775963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:12.776411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:12.777171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:12.777606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:12.907193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:12.915834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:12.917333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:12.918474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6ba491ba-753c-4114-a77d-90ac6bbf7f92 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.153673 Jul 12 18:56:12.919044 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 401/729] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:12 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:13.936121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:13.936726 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:13.943552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:13.944249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:13.945019 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:13.945458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:14.077342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:14.085939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:14.087446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:14.088578 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8cfd2fd1-7284-4478-bed5-68c984504bd2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.156423 Jul 12 18:56:14.089130 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 329/730] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:13 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:15.106318 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:15.106922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:15.113801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:15.114249 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:15.115125 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:15.116507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:15.249937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:15.260043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:15.261810 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:15.263089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d63f1156-6433-474d-9390-93cdedfd33c3 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.160469 Jul 12 18:56:15.263677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 402/731] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:15 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:16.281834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:16.282459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:16.289027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:16.289466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:16.290209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:16.290635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:16.417287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:16.425153 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:16.426826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:16.429281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5924a76f-3bef-4860-be5b-ef8c8d0173db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.151454 Jul 12 18:56:16.429855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 330/732] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:16 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:17.448615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:17.449224 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:17.455755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:17.456201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:17.456959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:17.457393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:17.583499 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:17.591882 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:17.593416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:17.594563 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9dca0091-32d7-4be9-ac21-87acdb7fa316 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.149900 Jul 12 18:56:17.595123 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 403/733] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:17 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:18.613483 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:18.614031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:18.621017 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:18.621728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:18.622498 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:18.622940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:18.757156 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:18.765416 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:18.766912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:18.768074 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e7f2e35d-074e-47f9-9683-94ef39f1386b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.158980 Jul 12 18:56:18.768675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 331/734] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:18 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:19.785970 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:19.786578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:19.793930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:19.794385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:19.795146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:19.795621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:19.928346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:19.938538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:19.940165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:19.941365 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5e6b8ce5-3fe6-4562-8c3a-a80f99680532 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.159309 Jul 12 18:56:19.942119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 404/735] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:19 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:20.959694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:20.960297 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:20.967719 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:20.968174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:20.968942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:20.969381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:21.105611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:21.113491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:21.115574 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:21.117216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4b1e2981-2cf7-456d-90ea-a52728865670 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.161428 Jul 12 18:56:21.117779 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 332/736] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:20 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:21.560208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-82971170-4a9d-483b-ae48-58223fc0694a req-79a744d1-fdf4-4e1c-8cca-c128befd4df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:21.569338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-82971170-4a9d-483b-ae48-58223fc0694a req-79a744d1-fdf4-4e1c-8cca-c128befd4df9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:21.569772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-82971170-4a9d-483b-ae48-58223fc0694a req-79a744d1-fdf4-4e1c-8cca-c128befd4df9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:21.581160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-82971170-4a9d-483b-ae48-58223fc0694a req-79a744d1-fdf4-4e1c-8cca-c128befd4df9 service nova] Creating event network-vif-plugged:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:56:21.586563 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-82971170-4a9d-483b-ae48-58223fc0694a req-79a744d1-fdf4-4e1c-8cca-c128befd4df9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030003 Jul 12 18:56:21.587152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 405/737] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:22.135202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:22.136103 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:22.142603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:22.143051 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:22.143842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:22.144277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:22.275268 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:22.283095 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:22.284613 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:22.285748 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f740647a-cc12-45c7-a6de-7710bfe0575b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.154693 Jul 12 18:56:22.286305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 333/738] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:22 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:23.306595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:23.307288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:23.313486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:23.313935 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:23.314694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:23.315127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:23.445870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:23.453796 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:23.455321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:23.456475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-49da3252-c61c-4f44-9230-6849e2a0c0a8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1744 microversion: 2.20 time: 0.155586 Jul 12 18:56:23.457057 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 406/739] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:23 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:24.477140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:24.481322 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:24.481322 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:24.484993 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:24.485448 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:24.486213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:24.486646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:24.490646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:24.622229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:24.630012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:24.632148 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:24.633163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-99b6f31a-207c-4520-9943-eff7e95718b4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.161287 Jul 12 18:56:24.640308 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 334/740] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:24 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:24.704557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-335971006", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163641014", "security_groups": [{"name": "tempest-secgroup-smoke-1862185695"}], "block_device_mapping_v2": [{"uuid": "9c32c773-4bbd-49d8-ae2b-71d4513b8740", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9d6ae291-a6e1-46b3-8050-3516d4ef624f"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:24.830004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] validate_networks() for [('9d6ae291-a6e1-46b3-8050-3516d4ef624f', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:56:25.644985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:56:25.644985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:56:25.644985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:56:25.644985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:56:25.644985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:56:25.651456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:25.651989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:25.652851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:25.653400 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:25.654360 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:25.655120 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:25.665110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:25.666948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:25.667685 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:25.668128 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:25.672194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:56:25.676461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for user 584b15b723a94f8bb380b76a2db97fc8 and project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:56:25.764626 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:56:25.768005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c32c773-4bbd-49d8-ae2b-71d4513b8740',volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:56:25.872227 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:25.881432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:25.883851 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:25.899574 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-773bfcf5-a9a1-4274-a261-7b08faf1f8b2 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.250939 Jul 12 18:56:25.901542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 335/741] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:25 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:26.175398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-353a3873-0f8e-4d1d-826a-0bfb005b71c0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.474965 Jul 12 18:56:26.182157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 407/742] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:56:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:56:26.187492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5fc0dde6-e71c-4081-9439-4deef7e60e0a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:26.192053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5fc0dde6-e71c-4081-9439-4deef7e60e0a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:26.268655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5fc0dde6-e71c-4081-9439-4deef7e60e0a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:26.281057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5fc0dde6-e71c-4081-9439-4deef7e60e0a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1094 microversion: 2.1 time: 0.097636 Jul 12 18:56:26.281656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 336/743] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:26 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:56:26.919043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:26.920435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:26.927448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:26.928164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:26.929659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:26.930156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:27.092286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:27.100416 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:27.102176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:27.103364 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5c3d0563-92bd-4277-a7df-08299b1e32e4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.188726 Jul 12 18:56:27.103927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 408/744] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:26 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:27.298419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:27.298985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:27.306521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:27.307315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:27.308090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:27.308517 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:27.399290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:27.406911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f3da21dc-12fa-4d5c-be69-c524f6fc9322 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1144 microversion: 2.1 time: 0.112815 Jul 12 18:56:27.407801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 337/745] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:27 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1144 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:28.122954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:28.263430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:28.263430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:28.263430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:28.263430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:28.264727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:28.279780 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:28.288805 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:28.290336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:28.291876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8179f19f-946f-4701-b4ba-e8857dbcf6a4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.173624 Jul 12 18:56:28.292443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 409/746] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:28 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:28.425264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:28.425868 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:28.432478 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:28.432919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:28.433670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:28.434101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:28.497408 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:28.508637 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8fdeb87f-527d-4b87-bfa1-a012374c258c tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1192 microversion: 2.1 time: 0.086842 Jul 12 18:56:28.509524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 338/747] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:28 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:29.310918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:29.312288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:29.316665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:29.321791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:29.322540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:29.323694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:29.324456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:29.528662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:29.530331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:29.544460 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:29.546644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:29.548719 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:29.551726 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:29.611861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:29.625918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:29.627571 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:29.629180 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-487190cf-8943-4d3c-9407-5e5f7efc5d75 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.322193 Jul 12 18:56:29.630755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 410/748] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:29 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:29.771890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:29.781451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e8765504-e3b2-4a13-b22f-80a7bc23aed9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1278 microversion: 2.1 time: 0.259084 Jul 12 18:56:29.784550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 339/749] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:29 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1278 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:30.651591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:30.653067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:30.666999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:30.666999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:30.666999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:30.666999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:30.798103 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:30.798958 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:30.808242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:30.810764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:30.810764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:30.817324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:31.105784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:31.113296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2e51c7f1-4b05-4f9a-9a6e-4bd73f55606e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.319054 Jul 12 18:56:31.123625 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 340/750] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:30 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:31.128476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-70802fb5-4bd3-4a61-8620-3db91fbf96be req-e43e4128-92b5-4f18-a7c9-a26d5c32a392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4323f482-9ab3-46cb-9047-09028e1c3527", "tag": "103f2b89-5be7-4326-bc62-884c245d9f91"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:31.140409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-70802fb5-4bd3-4a61-8620-3db91fbf96be req-e43e4128-92b5-4f18-a7c9-a26d5c32a392 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:31.141336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-70802fb5-4bd3-4a61-8620-3db91fbf96be req-e43e4128-92b5-4f18-a7c9-a26d5c32a392 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:31.141613 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:31.156661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-70802fb5-4bd3-4a61-8620-3db91fbf96be req-e43e4128-92b5-4f18-a7c9-a26d5c32a392 service nova] Creating event network-changed:103f2b89-5be7-4326-bc62-884c245d9f91 for instance 4323f482-9ab3-46cb-9047-09028e1c3527 on hv-cinder-83538 Jul 12 18:56:31.163695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-70802fb5-4bd3-4a61-8620-3db91fbf96be req-e43e4128-92b5-4f18-a7c9-a26d5c32a392 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037742 Jul 12 18:56:31.164939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 341/751] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:31.174336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:31.176114 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:31.177429 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-59144f63-ef8b-43b5-b272-4bb2a7165fe6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.531346 Jul 12 18:56:31.178147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 411/752] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:30 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:32.130959 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:32.133266 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:32.140747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:32.141270 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:32.142101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:32.142604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:32.197952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:32.199282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:32.209527 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:32.212001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:32.213034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:32.213651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:32.340958 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:32.349770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-75ed784d-0a87-49b7-9d8e-4ef81f3a3ab4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.222806 Jul 12 18:56:32.350701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 342/753] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:32 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:32.393388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:32.406787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:32.408316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:32.409577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-18ce8440-8f1a-4b91-b565-53ae5b022bd7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.216840 Jul 12 18:56:32.410752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 412/754] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:32 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:33.365981 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:33.367224 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:33.374064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:33.374525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:33.375413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:33.375977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:33.428266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:33.430165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:33.443708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:33.444993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:33.445955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:33.446542 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:33.455179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=93 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:33.589860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:33.597784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-04ebc495-04c5-47ba-b5c5-27775703fa8e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.235662 Jul 12 18:56:33.607742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 343/755] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:33 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:33.648511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:33.656622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:33.658141 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:33.661589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-340c8f80-7449-4530-8f8f-cb9a7c34ee5d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.234857 Jul 12 18:56:33.665649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 413/756] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:33 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:34.615085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:34.615731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:34.622284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:34.622726 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:34.623528 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:34.623942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:34.678278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:34.679442 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:34.686692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:34.687144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:34.687937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:34.688361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:34.800502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:34.809843 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4651e4b9-dfe0-4f98-a8f0-357a38228292 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.198473 Jul 12 18:56:34.820090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 344/757] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:34 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:34.848884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:34.857146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:34.858631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:34.859795 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7f1a0019-0079-4551-8045-2c8b866301ba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.186012 Jul 12 18:56:34.860347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 414/758] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:34 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:35.826844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:35.827485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:35.834011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:35.834468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:35.836190 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:35.836421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:35.878612 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:35.879331 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:35.883102 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:35.884302 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:35.888102 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:35.888547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:35.889309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:35.889864 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:36.024269 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:36.032278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-de309170-30f5-4dc9-92a8-7d2d8697c633 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.209731 Jul 12 18:56:36.033011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 345/759] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:35 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:36.061829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:36.070602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:36.071858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:36.073006 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d96ab513-5b72-458e-a3f9-d97798bcb20c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1739 microversion: 2.20 time: 0.198518 Jul 12 18:56:36.073553 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 415/760] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:35 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:37.046323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:37.050720 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:37.051351 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:37.058136 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:37.058597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:37.059391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:37.059832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:37.092098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:37.092908 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:37.100080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:37.100571 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:37.102075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:37.102522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:37.333516 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:37.344547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4d46c4bd-7c6c-4a57-b904-354a1117f1a9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.299207 Jul 12 18:56:37.345128 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 346/761] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:37 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:37.376059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:37.384527 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:37.386300 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:37.387490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f3241904-b0ba-4217-948f-3d6f8b456b70 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1721 microversion: 2.20 time: 0.299438 Jul 12 18:56:37.388054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 416/762] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:37 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:38.364184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:38.364791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:38.372140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:38.372587 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:38.373344 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:38.373775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:38.405833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:38.406433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:38.413730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:38.414371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:38.415171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:38.415635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:38.554116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:38.561668 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bdf3197d-ea3d-4322-a7c5-bafa86121003 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.201343 Jul 12 18:56:38.562232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 347/763] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:38 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:38.582325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:38.589569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:38.591083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:38.592258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5776ba08-9c42-4013-820f-e3c2b3b05414 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1721 microversion: 2.20 time: 0.190295 Jul 12 18:56:38.592815 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 417/764] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:38 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:39.579417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:39.580075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:39.586176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:39.586620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:39.587459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:39.587891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:39.603456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-b16c4b3d-2e7f-439c-ba79-2c13c7e7df8c req-cc7c1861-92e4-4b33-b74f-81969306cad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:39.613049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-b16c4b3d-2e7f-439c-ba79-2c13c7e7df8c req-cc7c1861-92e4-4b33-b74f-81969306cad6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:39.613569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-b16c4b3d-2e7f-439c-ba79-2c13c7e7df8c req-cc7c1861-92e4-4b33-b74f-81969306cad6 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:39.626023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-b16c4b3d-2e7f-439c-ba79-2c13c7e7df8c req-cc7c1861-92e4-4b33-b74f-81969306cad6 service nova] Creating event network-vif-unplugged:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:56:39.631097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-b16c4b3d-2e7f-439c-ba79-2c13c7e7df8c req-cc7c1861-92e4-4b33-b74f-81969306cad6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032387 Jul 12 18:56:39.635480 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 418/765] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:39.637378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:39.638190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:39.644482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:39.644919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:39.645670 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:39.646099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:39.767070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:39.775505 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-770e5c99-1c78-41d8-84b9-939d86d895f7 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.200087 Jul 12 18:56:39.776071 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 348/766] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:39 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:39.811774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:39.820230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:39.821777 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:39.822952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c56324e1-d087-4112-96e1-f7c7c221c180 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1721 microversion: 2.20 time: 0.189988 Jul 12 18:56:39.823547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 419/767] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:39 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:40.791963 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:40.792579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:40.799087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:40.799575 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:40.800340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:40.800776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:40.841184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:40.842410 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:40.848642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:40.849080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:40.849861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:40.850274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:41.227461 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:41.234550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:41.238306 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-676a5f40-b532-4be1-9dbb-ab50a5dcc8d5 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.447693 Jul 12 18:56:41.238306 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 349/768] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:40 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:41.244226 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:41.245731 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:41.246925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b472f837-6a65-49c9-9db6-3b82be1dac8f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1724 microversion: 2.20 time: 0.409646 Jul 12 18:56:41.247503 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 420/769] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:40 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:56:41.267822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "982f2f6f-0f25-43b1-ac3b-f9c3bee00e72"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:41.272387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:41.277476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:41.277922 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:41.278685 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:41.279110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:41.871187 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:42.228862 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7838d761-5692-4e19-ac12-c3120dec7e10 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.968224 Jul 12 18:56:42.229465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 350/770] 10.222.0.59 () {62 vars in 1363 bytes} [Tue Jul 12 18:56:41 2022] POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments => generated 188 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 12 18:56:42.252629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:42.253213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:42.260385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.261216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:42.261841 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.262268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:42.350262 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:42.351013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:42.358433 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.359135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:42.365915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.365915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:42.406324 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:42.414242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bd939ba8-dd8c-4aa6-995c-ebf9f6d2d1bb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.165446 Jul 12 18:56:42.414839 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 421/771] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:42 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:42.919192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1481ccee-a683-40be-92c8-3aa73ffd17fc tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments/982f2f6f-0f25-43b1-ac3b-f9c3bee00e72" status: 202 len: 0 microversion: 2.20 time: 0.574077 Jul 12 18:56:42.920116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 351/772] 10.222.0.59 () {60 vars in 1456 bytes} [Tue Jul 12 18:56:42 2022] DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments/982f2f6f-0f25-43b1-ac3b-f9c3bee00e72 => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:56:42.976507 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:42.977071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:42.983028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.983513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:42.984265 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:42.984695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.197172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a0925e2b-09dc-42a0-b92f-41e46e4abd38 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/action" status: 202 len: 0 microversion: 2.20 time: 0.224384 Jul 12 18:56:43.197895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 422/773] 10.222.0.59 () {62 vars in 1318 bytes} [Tue Jul 12 18:56:42 2022] POST /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:56:43.205844 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:43.206455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:43.213538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:43.213995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.214766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:43.215340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.347910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:43.356354 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:43.357846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:43.359109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1de9a145-6dab-4f74-94d7-de317a0f1e03 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1672 microversion: 2.20 time: 0.157218 Jul 12 18:56:43.359686 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 352/774] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:43 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:43.431971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:43.432583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:43.439208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:43.439682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.440475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:43.440909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.583717 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:43.591932 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-72bb66f1-b234-47c4-b843-a68157860b72 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.164931 Jul 12 18:56:43.592509 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 423/775] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:43 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:43.857437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-78f328f5-7cfe-4af4-a304-51ff9152d339 req-e55c7248-ccbd-4228-87a8-94c1ba9617f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323f482-9ab3-46cb-9047-09028e1c3527", "name": "network-vif-plugged", "status": "completed", "tag": "103f2b89-5be7-4326-bc62-884c245d9f91"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:43.865909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-78f328f5-7cfe-4af4-a304-51ff9152d339 req-e55c7248-ccbd-4228-87a8-94c1ba9617f3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:43.866349 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-78f328f5-7cfe-4af4-a304-51ff9152d339 req-e55c7248-ccbd-4228-87a8-94c1ba9617f3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:43.877009 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-78f328f5-7cfe-4af4-a304-51ff9152d339 req-e55c7248-ccbd-4228-87a8-94c1ba9617f3 service nova] Creating event network-vif-plugged:103f2b89-5be7-4326-bc62-884c245d9f91 for instance 4323f482-9ab3-46cb-9047-09028e1c3527 on hv-cinder-83538 Jul 12 18:56:43.881990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-78f328f5-7cfe-4af4-a304-51ff9152d339 req-e55c7248-ccbd-4228-87a8-94c1ba9617f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028341 Jul 12 18:56:43.882595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 353/776] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:44.378327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:44.378932 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:44.385497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:44.386205 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:44.386962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:44.387504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:44.515819 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:44.523829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:44.525328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:44.526460 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c9845040-0413-4382-a846-b403cc5ec21f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1674 microversion: 2.20 time: 0.152201 Jul 12 18:56:44.527011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 424/777] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:44 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:44.608942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:44.609741 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:44.616219 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:44.617174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:44.618016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:44.618449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:44.754885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:44.763188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9fda6296-d7d3-4994-9d3f-19b2e7f792e4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.158474 Jul 12 18:56:44.763823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 354/778] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:44 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:45.545589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:45.546199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:45.552753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:45.553200 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:45.553958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:45.555618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:45.682112 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:45.690194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:45.691745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:45.692933 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8d7d9705-2b5a-4635-b767-8788b266bc57 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.151291 Jul 12 18:56:45.693497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 425/779] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:45 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:45.779646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:45.780302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:45.786793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:45.787238 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:45.788023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:45.788456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:45.920091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:45.927902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2db59d26-f375-4b6b-b690-267629e2937b tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1266 microversion: 2.1 time: 0.152183 Jul 12 18:56:45.928476 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 355/780] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:45 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:46.712520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:46.713426 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:46.720171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:46.720616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:46.721383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:46.721820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:46.926685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:46.935477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:46.936987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:46.938144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5c2eacb3-2c87-4436-b24a-10cf12150163 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.230799 Jul 12 18:56:46.939038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 426/781] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:46 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:46.944137 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:46.944746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:46.951339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:46.951788 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:46.952544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:46.952971 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:47.103069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:47.110605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-68735451-2a3e-4746-85c5-7531bc365753 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1454 microversion: 2.1 time: 0.170276 Jul 12 18:56:47.111172 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 356/782] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:46 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:47.130830 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:47.131493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:47.138557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:47.139009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:47.139807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:47.140253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:47.275618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:47.283292 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1d31bccc-1981-4129-8e35-34c536aac468 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1454 microversion: 2.1 time: 0.156506 Jul 12 18:56:47.283903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 427/783] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:56:47 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:56:47.958695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:47.959897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:47.968253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:47.968923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:47.970012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:47.970837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:48.209049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:48.218059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:48.219638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:48.220808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1342987f-0ea2-4820-80a2-5330ad2b9425 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.268137 Jul 12 18:56:48.221411 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 357/784] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:47 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:49.239460 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:49.240091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:49.250575 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:49.251024 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:49.251851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:49.252655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:49.528168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:49.543514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:49.545190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:49.546436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d25d5f50-8e52-42ab-abeb-ad0c76a04dad tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.311317 Jul 12 18:56:49.547090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 428/785] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:49 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:49.654634 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-f372cbab-e1ce-4d3b-9ae4-1d954439e235 req-fab2da4e-3acb-4b67-ae08-a596db9d94d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4323f482-9ab3-46cb-9047-09028e1c3527", "tag": "103f2b89-5be7-4326-bc62-884c245d9f91"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:56:49.664320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-f372cbab-e1ce-4d3b-9ae4-1d954439e235 req-fab2da4e-3acb-4b67-ae08-a596db9d94d8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:49.671879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-f372cbab-e1ce-4d3b-9ae4-1d954439e235 req-fab2da4e-3acb-4b67-ae08-a596db9d94d8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:49.677119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-f372cbab-e1ce-4d3b-9ae4-1d954439e235 req-fab2da4e-3acb-4b67-ae08-a596db9d94d8 service nova] Creating event network-changed:103f2b89-5be7-4326-bc62-884c245d9f91 for instance 4323f482-9ab3-46cb-9047-09028e1c3527 on hv-cinder-83538 Jul 12 18:56:49.682948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-f372cbab-e1ce-4d3b-9ae4-1d954439e235 req-fab2da4e-3acb-4b67-ae08-a596db9d94d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032244 Jul 12 18:56:49.683777 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 358/786] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:50.565912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:50.567276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:50.574484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:50.575007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:50.575918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:50.576471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:50.593468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:50.739654 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:50.752008 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:50.753798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:50.755197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0a39849a-4450-40ff-88d3-d106cebe4cff tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.193281 Jul 12 18:56:50.755827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 429/787] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:50 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:51.190637 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:51.191278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:51.199888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.200336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.201336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.201769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.311042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'services' on Instance uuid ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:56:51.537135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3ab2e228-5979-40f3-9831-26def0500a4c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments/f7429349-9760-4220-a25e-832ed7e677b7" status: 202 len: 0 microversion: 2.1 time: 0.351403 Jul 12 18:56:51.537770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 359/788] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:56:51 2022] DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments/f7429349-9760-4220-a25e-832ed7e677b7 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:56:51.546799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:51.547952 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:51.555179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.555179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.555911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.556336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.589572 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3498c356-ee08-4340-b3d8-e25b7a130944 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Jul 12 18:56:51.590287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 430/789] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:51 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:51.775567 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:51.776257 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:51.784657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.785383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.786150 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:51.786584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:51.930307 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:51.938491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:51.940044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:51.941194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e25d6eb0-1216-4940-b846-cb60698d88cd tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.171001 Jul 12 18:56:51.941944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 360/790] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:51 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:52.602479 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:52.603417 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:52.616069 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:52.616707 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:52.618218 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:52.621431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:52.653307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-691a3dcc-0d68-4c2c-bc0b-3e015b136b1a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055479 Jul 12 18:56:52.654093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 431/791] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:52 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:52.962032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:52.962716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:52.969340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:52.969792 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:52.970558 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:52.970987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:53.112326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:53.120421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:53.122136 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:53.123343 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b1fbd91f-82f4-4d7f-8e3d-369c49d3b7be tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.166668 Jul 12 18:56:53.123975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 361/792] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:52 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:53.665379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:53.667227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:53.674116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:53.674639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:53.675512 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:53.676010 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:53.712471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b027b51a-2f15-465c-a470-b747d8bbff3e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048009 Jul 12 18:56:53.712471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 432/793] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:53 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:54.142333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:54.142866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:54.150182 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:54.150837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:54.151649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:54.152079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:54.286967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:54.294987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:54.296523 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:54.297665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5c5b4519-73fc-46d0-a0d4-0bc9d84ec8b8 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.159315 Jul 12 18:56:54.298235 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 362/794] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:54 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:54.723333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:54.724245 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:54.731595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:54.732032 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:54.732779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:54.733200 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:54.763520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ca37d442-6950-400c-b229-a932f4041e34 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Jul 12 18:56:54.764206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 433/795] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:54 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:55.317237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:55.317846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:55.320274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=60 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:55.325735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:55.326195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:55.326966 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:55.327445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:55.465902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:55.474837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:55.476378 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:55.477620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-05e66c5c-919a-44a0-b8f8-4f6c9944fd61 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.164225 Jul 12 18:56:55.478159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 363/796] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:55 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:55.776487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:55.777414 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:55.784065 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:55.784514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:55.785280 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:55.785713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:55.816919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3d86218c-fdb1-4510-bb13-2b9f89e98aca tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Jul 12 18:56:55.820977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 434/797] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:55 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:56.496169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:56.496876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:56.504728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:56.504923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:56.505832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:56.506463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:56.526853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=4,nova_cell1:SELECT=89 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:56:56.646497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:56.656618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:56.658119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:56.659357 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-aa2b0dce-70d5-42c4-ad13-43ec3c5d810f tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.167058 Jul 12 18:56:56.660134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 364/798] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:56 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:56.829194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:56.830253 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:56.838083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:56.838534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:56.839321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:56.839790 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:56.870700 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d9122391-34e2-4655-8edf-33fb47f6867d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Jul 12 18:56:56.871282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 435/799] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:56 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:57.144078 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:57.144560 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:57.151742 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.152180 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.152950 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.153367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.176699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d523a278-70e5-4bf5-9bcc-b8c4b6669fd2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/ips" status: 200 len: 147 microversion: 2.1 time: 0.036337 Jul 12 18:56:57.177497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 365/800] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 18:56:57 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:56:57.678109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:57.678706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:57.684867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.685252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.685992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.686418 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.819572 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:57.828282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:57.829770 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:57.830903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b82022f3-4411-4329-a207-c455d6f95f1e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.156709 Jul 12 18:56:57.831487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 436/801] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:57 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:57.882270 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:57.883944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:57.891050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.891540 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.892314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:57.892757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:57.923752 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-492f3d53-d0a2-4208-8fa1-c537d48713a6 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045529 Jul 12 18:56:57.924499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 366/802] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:57 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:58.849556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:58.850154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:58.857246 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:58.857688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:58.858438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:58.858864 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:58.937093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:58.938083 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:58.944469 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:58.944981 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:58.945678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:58.947061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:56:58.979273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d4b06c81-0d79-4701-8f71-817de70a801a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Jul 12 18:56:58.979946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 367/803] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:58 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:56:59.002250 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:59.010784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:59.012585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:56:59.013727 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8dae4567-1018-4156-bcce-5c2ecc733bba tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.168117 Jul 12 18:56:59.014292 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 437/804] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:56:58 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:56:59.990850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:56:59.991822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:56:59.999049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:56:59.999603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.002746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:00.005367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.027530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b5339b4-dbd0-4567-b99c-639c5101c075"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:00.028592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:00.030863 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=58 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:00.035522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:00.035962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.036710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:00.037136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.037423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b01104d7-4504-43b5-8628-88e575c4bc6c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050431 Jul 12 18:57:00.038298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 368/805] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:56:59 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:00.043478 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:00.049485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:00.049703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:00.050159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.050922 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:00.051387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:00.184544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:00.192285 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:00.193774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:00.194908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e463155e-819d-4348-8005-ba7afde8fde4 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.155709 Jul 12 18:57:00.195475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 369/806] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:00 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:01.059119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:01.060076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:01.066508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:01.066953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:01.067746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:01.068177 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:01.104081 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3a0a0a36-0257-4d24-9dc7-05f861876f3c tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049480 Jul 12 18:57:01.104647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 370/807] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:01 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:57:01.213533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:01.214155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:01.220209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:01.220670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:01.221516 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:01.221933 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:01.354697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:01.362750 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:01.364273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:01.365424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-00ba9092-1fc4-498e-bdf7-9ddc4d338a9d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.156029 Jul 12 18:57:01.366025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 371/808] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:01 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:57:01.433573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f3906c5a-a4d7-457c-897b-5b0fb7322611 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.409974 Jul 12 18:57:01.434258 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 438/809] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:57:00 2022] POST /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 194 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:57:02.115969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:02.116897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:02.124090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:02.124539 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:02.125331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:02.125769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:02.155481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3741f3d5-3131-4b03-939c-25318cd8e93b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Jul 12 18:57:02.156027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 372/810] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:02 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:02.385769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:02.386764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:02.393532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:02.393979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:02.394738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:02.395177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:02.824345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:02.824345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:02.825028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:02.825028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1620ed87-d61e-4849-b914-e64f14856170 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.384844 Jul 12 18:57:02.825028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 439/811] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:02 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:03.167530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:03.168475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:03.175814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:03.176270 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:03.177197 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:03.177636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:03.217608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-36764c4d-1aff-4ec4-b7d3-01b139f6cb98 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055144 Jul 12 18:57:03.218391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 373/812] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:03 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:03.841359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:03.843188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:03.848505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:03.848951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:03.849744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:03.850172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:04.037511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:04.046577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:04.048130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:04.049348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9f2ee0dc-4c2a-4c88-87dd-29e7b7a0bba5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.212684 Jul 12 18:57:04.049870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 440/813] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:03 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:04.230452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:04.231404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:04.237968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:04.238420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:04.239200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:04.239667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:04.269784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8896c539-eda9-4bfc-9895-ab78fc3f5f27 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Jul 12 18:57:04.270339 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 374/814] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:04 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:05.068903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:05.069468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:05.076201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.076649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.077413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.077906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.207019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:05.215526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:05.217062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:05.218233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2ddc07dd-4b4d-4054-982f-2438387fd07e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.153374 Jul 12 18:57:05.218794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 441/815] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:05 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:05.282056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:05.282998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:05.289442 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.289889 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.290644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.291108 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.318165 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e494e8d1-884d-422f-9beb-2491242d3336 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040023 Jul 12 18:57:05.318709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 375/816] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:05 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:57:05.394197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:05.394698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:05.400890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.401371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.402129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.402561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.426906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:57:05.658104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8280ad4c-4f6d-4586-ae65-479eae09b98b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 204 len: 0 microversion: 2.1 time: 0.267551 Jul 12 18:57:05.659028 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 442/817] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:05 2022] DELETE /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:57:05.667989 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:05.668598 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:05.674804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.675249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.676054 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.676489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.781224 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-d8c8b4ea-f11f-4224-b637-c0bf7429fedb req-800a0e00-be6e-4f70-ac5b-574bb8828af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:05.789488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-d8c8b4ea-f11f-4224-b637-c0bf7429fedb req-800a0e00-be6e-4f70-ac5b-574bb8828af5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:05.790002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-d8c8b4ea-f11f-4224-b637-c0bf7429fedb req-800a0e00-be6e-4f70-ac5b-574bb8828af5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:05.794692 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:05.802033 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-d8c8b4ea-f11f-4224-b637-c0bf7429fedb req-800a0e00-be6e-4f70-ac5b-574bb8828af5 service nova] Creating event network-vif-plugged:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:57:05.807004 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-d8c8b4ea-f11f-4224-b637-c0bf7429fedb req-800a0e00-be6e-4f70-ac5b-574bb8828af5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030300 Jul 12 18:57:05.807634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 443/818] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:05.816139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:05.824088 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2df3c299-cf8f-4ac1-8a94-b66e33581db1 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1690 microversion: 2.1 time: 0.160808 Jul 12 18:57:05.824646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 376/819] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:05 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:57:06.238098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:06.238796 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:06.246073 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:06.246523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:06.247315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:06.247754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:06.377919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:06.386879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:06.388506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:06.389696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dcd679e4-2eed-43d3-98f1-ccad9e9f34b6 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.156791 Jul 12 18:57:06.390256 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 444/820] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:06 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:06.841689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:06.842298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:06.848858 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:06.849313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:06.850075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:06.850511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:06.984175 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:06.991689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-41ce6245-97d9-47e5-88bf-63588554b9a8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1690 microversion: 2.1 time: 0.154427 Jul 12 18:57:06.992253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 377/821] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:06 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:07.408039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:07.408598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:07.415074 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:07.415557 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:07.416350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:07.416778 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:07.546898 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:07.554806 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:07.556335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:07.557665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f529b171-fb7d-4d40-8dad-e1e8e05074c1 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.153378 Jul 12 18:57:07.558225 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 445/822] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:07 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:08.009142 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:08.010004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:08.016860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:08.017310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:08.018070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:08.018503 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:08.144836 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:08.152579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4e1feaca-57ae-43b4-9eb9-93cb1258206a tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1690 microversion: 2.1 time: 0.147332 Jul 12 18:57:08.153146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 378/823] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:08 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:08.576446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:08.577047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:08.583522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:08.583965 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:08.584722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:08.585153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:08.720729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:08.729490 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:08.730979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:08.732145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e3908aab-dbb9-4ebe-9909-3fc3ad1e03c0 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.159728 Jul 12 18:57:08.733009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 446/824] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:08 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:09.170781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:09.172829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:09.178946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:09.179435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:09.180213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:09.180656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:09.388704 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:09.396092 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a163d779-250d-4438-baa8-f95c1cd3cf80 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1690 microversion: 2.1 time: 0.230491 Jul 12 18:57:09.396648 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 379/825] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:09 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:09.750466 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:09.751003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:09.757433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:09.757878 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:09.758630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:09.759067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:09.896618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:09.904878 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:09.906312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:09.907491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b03e7411-2287-4004-8746-6002c53c5683 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.160944 Jul 12 18:57:09.908052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 447/826] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:09 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:10.413326 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:10.414016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:10.420069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:10.420514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:10.421268 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:10.421699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:10.554338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:10.562085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2b7ab47e-9747-4353-a6aa-7b4703450346 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1690 microversion: 2.1 time: 0.152786 Jul 12 18:57:10.562666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 380/827] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:10 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:10.926705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:10.936337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:10.942982 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:10.943753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:10.944812 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:10.945883 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:10.982111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-dd7cea49-f65d-4d9e-935e-6bfde94a8599 req-a7a6b077-9b9d-4cd5-b731-cd7beb2c7837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7", "name": "network-vif-deleted", "tag": "ac2e80ea-a465-4865-b718-4d6524f27bc7"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:10.991459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-dd7cea49-f65d-4d9e-935e-6bfde94a8599 req-a7a6b077-9b9d-4cd5-b731-cd7beb2c7837 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:10.991906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-dd7cea49-f65d-4d9e-935e-6bfde94a8599 req-a7a6b077-9b9d-4cd5-b731-cd7beb2c7837 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:11.005861 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-dd7cea49-f65d-4d9e-935e-6bfde94a8599 req-a7a6b077-9b9d-4cd5-b731-cd7beb2c7837 service nova] Creating event network-vif-deleted:ac2e80ea-a465-4865-b718-4d6524f27bc7 for instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 on hv-cinder-83538 Jul 12 18:57:11.012039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-dd7cea49-f65d-4d9e-935e-6bfde94a8599 req-a7a6b077-9b9d-4cd5-b731-cd7beb2c7837 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034351 Jul 12 18:57:11.016619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 381/828] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:11.093620 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:11.102094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:11.104667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:11.105921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6f863c93-ca8a-45c4-8fc5-a84d087aa29c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.183230 Jul 12 18:57:11.106560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 448/829] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:10 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 12 18:57:11.580170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:11.580979 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:11.589203 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:11.589415 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:11.590254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:11.590868 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:11.595430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:11.819983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:11.829250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f3b81e54-92a1-4a80-8e78-4b8c2027ac59 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1330 microversion: 2.1 time: 0.253299 Jul 12 18:57:11.829980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 382/830] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:11 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1330 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:12.124471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:12.125079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:12.131848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:12.132533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:12.134160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:12.134160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:12.269388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:12.277568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:12.279129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:12.280298 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3a077656-244c-4cf5-81fe-9ad6c8b5e717 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1730 microversion: 2.20 time: 0.159902 Jul 12 18:57:12.280861 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 449/831] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:12 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:12.846946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:12.847587 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:12.854430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:12.854879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:12.855675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:12.856262 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:12.887628 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:12.888082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:12.888531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'fault' on Instance uuid ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:57:12.933491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:12.941048 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-db292e93-709b-4b09-956e-e5b5636dfaf8 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 200 len: 1335 microversion: 2.1 time: 0.097999 Jul 12 18:57:12.941596 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 383/832] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:12 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 1335 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:57:13.165015 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:13.166550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:13.172962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.173399 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.174149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.174573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.202914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-506f13bd-c647-4254-8493-723940291c55 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 Jul 12 18:57:13.203498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 450/833] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:13 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:13.215406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:13.215855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:13.222020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.222472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.223236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.223709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.252209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e23942fc-4ecb-4a03-96c9-8e838caa7672 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075" status: 200 len: 194 microversion: 2.1 time: 0.042946 Jul 12 18:57:13.252766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 384/834] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Jul 12 18:57:13 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:13.297726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:13.298327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:13.304236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.304676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.305420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.305847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.434603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:13.443178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:13.444723 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:13.445877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f8df777f-76dc-440c-90f6-8a1cd0ef310c tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1717 microversion: 2.20 time: 0.151943 Jul 12 18:57:13.446444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 451/835] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:57:13 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:57:13.958065 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:13.958675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:13.966079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.966530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.967296 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:13.967750 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:13.982166 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] HTTP exception thrown: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Request method failure captured: Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 HTTP/1.1 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcJmcmVtXABsamAjtF1ISXeDG2KdSyduJ1o4ZF-tgxw6vBX6aKS0Kj3uhpoAmzqeaGJYUNHwdbXNveA-rMN8BCQeDzyQhgCbg3BLWAk14wyK9fc3hyNvxj2wAi-DAYto84xToWz0NHPfjhOT2A0HrjxkSLvJwz1T2nNMorPMUP2wnY0 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:57:13.984045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eb4f266e82834cc7930a4e60343660c9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 56363156a2b046fca40df895b3f6a050 Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. Jul 12 18:57:13.985674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7'} Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:13.986542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. Jul 12 18:57:13.987840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:13.989087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Returning 404 to user: Instance ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:13.989087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0bac7c1c-2d9a-4cf9-92a0-5b63d4045c1d tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7" status: 404 len: 111 microversion: 2.1 time: 0.031370 Jul 12 18:57:13.989087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 385/836] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:13 2022] GET /compute/v2.1/servers/ee9b8fdb-8738-466d-9c6d-1ae3c9da91a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:13.994503 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9af3a425-b070-4a1d-8d1c-6c6111b536e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '.version_select at 0x7f01783a2940>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:14.046464 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9af3a425-b070-4a1d-8d1c-6c6111b536e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942721721" status: 202 len: 0 microversion: 2.1 time: 0.055787 Jul 12 18:57:14.047066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 452/837] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Jul 12 18:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1942721721 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:57:14.783134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8952d314-e0b6-454c-804b-05ca83ca5bf5"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:14.784305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:14.790579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:14.791688 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:14.792552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:14.793050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:15.569596 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d32e3cd6-9a1d-45dd-859b-57aa815107c8 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "POST /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790217 Jul 12 18:57:15.570331 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 386/838] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 18:57:14 2022] POST /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:17.295212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:17.295745 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:17.302255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:17.302700 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:17.303522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:17.303955 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:17.329618 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:57:17.565779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-757040f9-bf15-49c4-9bb7-3296ef4d6b96 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 204 len: 0 microversion: 2.1 time: 0.274150 Jul 12 18:57:17.566367 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 453/839] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:17 2022] DELETE /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:57:17.575457 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:17.576298 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:17.582603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:17.583067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:17.583891 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:17.584329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:17.713729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:17.721885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-abe98cb4-1212-400e-b2b3-57121bc063f9 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1508 microversion: 2.1 time: 0.151227 Jul 12 18:57:17.722982 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 387/840] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:17 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:18.738937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:18.739921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:18.746927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:18.747635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:18.748492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:18.748959 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:18.919785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:18.927680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2b66dca1-e909-49e5-b8cf-4f03095b0e56 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 200 len: 1508 microversion: 2.1 time: 0.193313 Jul 12 18:57:18.928248 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 454/841] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:18 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 1508 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:19.031573 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-1ef86349-ceea-4b7f-a4ec-eb54e37ca90e req-18b85964-71cd-4805-a4b6-344f421f48ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15adaf4d-81dd-4ada-9e5d-6c16735b22c8", "name": "network-vif-deleted", "tag": "1e161cab-9e97-4d8e-9f6f-144fe879a320"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:19.040202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1ef86349-ceea-4b7f-a4ec-eb54e37ca90e req-18b85964-71cd-4805-a4b6-344f421f48ea service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:19.040642 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1ef86349-ceea-4b7f-a4ec-eb54e37ca90e req-18b85964-71cd-4805-a4b6-344f421f48ea service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:19.051948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-1ef86349-ceea-4b7f-a4ec-eb54e37ca90e req-18b85964-71cd-4805-a4b6-344f421f48ea service nova] Creating event network-vif-deleted:1e161cab-9e97-4d8e-9f6f-144fe879a320 for instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 on hv-cinder-83538 Jul 12 18:57:19.057161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-1ef86349-ceea-4b7f-a4ec-eb54e37ca90e req-18b85964-71cd-4805-a4b6-344f421f48ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029308 Jul 12 18:57:19.057938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 388/842] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:57:19.945056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:19.945722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 15adaf4d-81dd-4ada-9e5d-6c16735b22c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:19.952918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:19.955188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:19.955188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:19.955188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:19.968821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] HTTP exception thrown: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Request method failure captured: Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 HTTP/1.1 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcJmcmVtXABsamAjtF1ISXeDG2KdSyduJ1o4ZF-tgxw6vBX6aKS0Kj3uhpoAmzqeaGJYUNHwdbXNveA-rMN8BCQeDzyQhgCbg3BLWAk14wyK9fc3hyNvxj2wAi-DAYto84xToWz0NHPfjhOT2A0HrjxkSLvJwz1T2nNMorPMUP2wnY0 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:57:19.970539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eb4f266e82834cc7930a4e60343660c9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 56363156a2b046fca40df895b3f6a050 Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. Jul 12 18:57:19.972722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '15adaf4d-81dd-4ada-9e5d-6c16735b22c8'} Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:19.974023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. Jul 12 18:57:19.975640 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:19.976966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Returning 404 to user: Instance 15adaf4d-81dd-4ada-9e5d-6c16735b22c8 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:19.976966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-094a3ded-3611-42cd-b869-ecb12082dcd5 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8" status: 404 len: 111 microversion: 2.1 time: 0.030921 Jul 12 18:57:19.976966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 455/843] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:19 2022] GET /compute/v2.1/servers/15adaf4d-81dd-4ada-9e5d-6c16735b22c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:19.981529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:19.982466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:19.989109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:19.989594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:19.990364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:19.990802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:20.017583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:57:20.273953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fc18ee98-24d4-4645-bf54-1ae920023666 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "DELETE /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 204 len: 0 microversion: 2.1 time: 0.296922 Jul 12 18:57:20.274608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 389/844] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:19 2022] DELETE /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:57:20.283455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:20.284096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:20.290147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:20.290593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:20.291395 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:20.291808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:20.424774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:20.432169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0f12c550-f457-49c7-9a76-44fc0fda87fc tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.152771 Jul 12 18:57:20.432725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 456/845] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:20 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:21.449600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:21.450388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:21.456912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:21.457360 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:21.458117 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:21.458548 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:21.589310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:21.596839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-248dfd1f-2b87-407d-bc8e-efd0d4a8221b tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.151444 Jul 12 18:57:21.597398 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 390/846] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:21 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:22.614114 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:22.615912 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:22.621196 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:22.621643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:22.622412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:22.622846 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:22.829620 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:22.837203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9644f7e1-8aaa-4d7b-89ad-a8dc020f519e tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1521 microversion: 2.1 time: 0.227020 Jul 12 18:57:22.837858 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 457/847] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:22 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:23.109875 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-8f2d6a7f-73ff-4fb6-b3ef-07e6aad844d8 req-8e3985ab-4c59-4277-98f6-b1da727dde94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e2ae99-c398-460c-a71b-c02a1e76c13e", "name": "network-vif-deleted", "tag": "237c4a81-1ac3-4862-8876-ca6beae0569d"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:23.118427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-8f2d6a7f-73ff-4fb6-b3ef-07e6aad844d8 req-8e3985ab-4c59-4277-98f6-b1da727dde94 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:23.118865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-8f2d6a7f-73ff-4fb6-b3ef-07e6aad844d8 req-8e3985ab-4c59-4277-98f6-b1da727dde94 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:23.130154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-8f2d6a7f-73ff-4fb6-b3ef-07e6aad844d8 req-8e3985ab-4c59-4277-98f6-b1da727dde94 service nova] Creating event network-vif-deleted:237c4a81-1ac3-4862-8876-ca6beae0569d for instance 99e2ae99-c398-460c-a71b-c02a1e76c13e on hv-cinder-83538 Jul 12 18:57:23.134932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-8f2d6a7f-73ff-4fb6-b3ef-07e6aad844d8 req-8e3985ab-4c59-4277-98f6-b1da727dde94 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029264 Jul 12 18:57:23.135541 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 391/848] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:23.856168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:23.856776 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:23.863561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:23.864011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:23.864779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:23.865216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:23.896610 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:23.896990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:23.897436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lazy-loading 'fault' on Instance uuid 99e2ae99-c398-460c-a71b-c02a1e76c13e {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:57:23.942313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56363156a2b046fca40df895b3f6a050', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb4f266e82834cc7930a4e60343660c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:23.950355 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-de0d340a-b227-46b0-a831-d825a002c2e0 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 200 len: 1311 microversion: 2.1 time: 0.098102 Jul 12 18:57:23.951235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 458/849] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:23 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:24.117319 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:24.118383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:24.125522 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.125969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.126735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.127167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.157518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-09c44908-1ac6-4340-98cd-2628f905e053 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044325 Jul 12 18:57:24.158236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 392/850] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:24 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:24.302251 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:24.302733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:24.308665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.309108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.309851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.310284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.339671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2fe12ae6-6c22-43d1-8f4b-670d0d7d368e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075" status: 200 len: 194 microversion: 2.1 time: 0.041504 Jul 12 18:57:24.340315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 459/851] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Jul 12 18:57:24 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:24.350262 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:24.350743 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:24.356759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.357258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.358504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.358933 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.437502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lazy-loading 'services' on Instance uuid 811f414f-708a-4313-9909-6c6c4eaba7cd {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:57:24.673888 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-55d420f2-cce1-4b41-84eb-0be2dc1a098c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075" status: 202 len: 0 microversion: 2.1 time: 0.327365 Jul 12 18:57:24.674399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 393/852] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:57:24 2022] DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/1b5339b4-dbd0-4567-b99c-639c5101c075 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:57:24.970744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:24.971377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] [instance: 99e2ae99-c398-460c-a71b-c02a1e76c13e] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:24.977831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.978272 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.979033 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:24.979498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:24.982251 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:24.993665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] HTTP exception thrown: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Request method failure captured: Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e HTTP/1.1 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcJmcmVtXABsamAjtF1ISXeDG2KdSyduJ1o4ZF-tgxw6vBX6aKS0Kj3uhpoAmzqeaGJYUNHwdbXNveA-rMN8BCQeDzyQhgCbg3BLWAk14wyK9fc3hyNvxj2wAi-DAYto84xToWz0NHPfjhOT2A0HrjxkSLvJwz1T2nNMorPMUP2wnY0 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:57:24.997381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_eb4f266e82834cc7930a4e60343660c9", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/eb4f266e82834cc7930a4e60343660c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: eb4f266e82834cc7930a4e60343660c9 Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1077030308 Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 56363156a2b046fca40df895b3f6a050 Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1077030308-project Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. Jul 12 18:57:24.999757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '99e2ae99-c398-460c-a71b-c02a1e76c13e'} Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:25.000783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. Jul 12 18:57:25.002231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:25.003707 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] Returning 404 to user: Instance 99e2ae99-c398-460c-a71b-c02a1e76c13e could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:25.003707 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0ab0e310-ecd3-4de8-8f42-09065e66c3b4 tempest-ServerRescueNegativeTestJSON-1077030308 tempest-ServerRescueNegativeTestJSON-1077030308-project] 10.222.0.59 "GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e" status: 404 len: 111 microversion: 2.1 time: 0.029865 Jul 12 18:57:25.003707 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 460/853] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:24 2022] GET /compute/v2.1/servers/99e2ae99-c398-460c-a71b-c02a1e76c13e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:26.852253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:26.852832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:26.855029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:26.861038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:26.861599 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:26.862589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:26.863196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:26.894928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-27bc9180-38a6-46e4-be41-044dd79c1f87 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/8952d314-e0b6-454c-804b-05ca83ca5bf5" status: 200 len: 194 microversion: 2.1 time: 0.047665 Jul 12 18:57:26.895576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 394/854] 10.222.0.59 () {58 vars in 1412 bytes} [Tue Jul 12 18:57:26 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/8952d314-e0b6-454c-804b-05ca83ca5bf5 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:26.906088 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:26.906697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:26.913988 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:26.914439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:26.915214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:26.915696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:27.002752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lazy-loading 'services' on Instance uuid 811f414f-708a-4313-9909-6c6c4eaba7cd {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:57:27.232518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4f6686f7-4b5c-4aa9-b02a-dfe61000371c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/8952d314-e0b6-454c-804b-05ca83ca5bf5" status: 202 len: 0 microversion: 2.1 time: 0.330859 Jul 12 18:57:27.239882 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 461/855] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 18:57:26 2022] DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments/8952d314-e0b6-454c-804b-05ca83ca5bf5 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:57:29.471368 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:29.472348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:29.481550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.481550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.482161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.482597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.515046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c8e2ba0c-3245-444f-976d-f0a9cdb7793e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048388 Jul 12 18:57:29.515644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 395/856] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:29 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:57:29.627630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:29.628711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:29.635143 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.635627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.636646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.637087 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.666646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fb815fda-c056-4df4-b16e-ebeae71d83e0 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044249 Jul 12 18:57:29.667199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 462/857] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 18:57:29 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 18:57:29.729843 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:29.730341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:29.736354 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.736799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.737554 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:29.737988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:29.762032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:57:29.765572 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:30.034173 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-128a7822-203f-49d2-9f94-18d82407f7f7 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 204 len: 0 microversion: 2.1 time: 0.308161 Jul 12 18:57:30.035174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 396/858] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:29 2022] DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:57:30.044259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:30.047880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:30.054144 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:30.054593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:30.055421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:30.055927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:30.192301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:30.200039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-64f1f492-9668-43b8-b9f1-f39edec64bdb tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1675 microversion: 2.1 time: 0.160671 Jul 12 18:57:30.200620 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 463/859] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:30 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:31.218452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:31.219197 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:31.225610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:31.226118 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:31.226886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:31.227364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:31.363944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:31.371545 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d6efca3b-a7e0-4811-8aae-207641d4eb01 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1675 microversion: 2.1 time: 0.157413 Jul 12 18:57:31.372113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 397/860] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:31 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:32.389981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:32.390534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:32.393029 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:32.397720 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:32.398161 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:32.398916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:32.399438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:32.643800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:32.651450 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0c66706d-14a1-4405-8481-29d828e1d30b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1675 microversion: 2.1 time: 0.266313 Jul 12 18:57:32.662216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 464/861] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:32 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:33.421834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-e72da98b-51c6-4259-8d30-a51cfa6a00cf req-1e43aa64-a373-49ed-aa2d-bd32639e8607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811f414f-708a-4313-9909-6c6c4eaba7cd", "name": "network-vif-deleted", "tag": "b87fdb7e-c917-4f1e-88a0-c74afb7755d8"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:57:33.430665 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-e72da98b-51c6-4259-8d30-a51cfa6a00cf req-1e43aa64-a373-49ed-aa2d-bd32639e8607 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:33.431186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-e72da98b-51c6-4259-8d30-a51cfa6a00cf req-1e43aa64-a373-49ed-aa2d-bd32639e8607 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:33.443323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-e72da98b-51c6-4259-8d30-a51cfa6a00cf req-1e43aa64-a373-49ed-aa2d-bd32639e8607 service nova] Creating event network-vif-deleted:b87fdb7e-c917-4f1e-88a0-c74afb7755d8 for instance 811f414f-708a-4313-9909-6c6c4eaba7cd on hv-cinder-83538 Jul 12 18:57:33.448202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-e72da98b-51c6-4259-8d30-a51cfa6a00cf req-1e43aa64-a373-49ed-aa2d-bd32639e8607 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031083 Jul 12 18:57:33.448874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 398/862] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:57:33.669946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:33.671545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:33.678200 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:33.678649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:33.679475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:33.679914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:33.745513 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26993e3a077449da9c71fa7f1023a1e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b14300d453444a582d224fcee029d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:57:33.753867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-96be31f5-2c92-4f0b-bd3c-cbbe686bc12b tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 200 len: 1322 microversion: 2.1 time: 0.087904 Jul 12 18:57:33.754443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 465/863] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:33 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 1322 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:34.772415 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:34.773179 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:34.779278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:34.779772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:34.780570 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:34.781002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:34.793908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd HTTP/1.1 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:57:34.795810 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:34.797546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '811f414f-708a-4313-9909-6c6c4eaba7cd'} Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:34.798472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:34.800045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:34.801355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:34.801355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9f636961-f886-4eb4-9b5d-e80ff6306915 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 404 len: 111 microversion: 2.1 time: 0.029707 Jul 12 18:57:34.801355 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 399/864] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:34 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:34.806019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e363e667-b48e-4da5-9568-a394cbf4bef2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '.version_select at 0x7f0178465ca0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:34.898322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e363e667-b48e-4da5-9568-a394cbf4bef2 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-134881367" status: 202 len: 0 microversion: 2.1 time: 0.095946 Jul 12 18:57:34.898920 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 466/865] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Jul 12 18:57:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-134881367 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 18:57:38.168340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:38.168987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:38.176651 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:38.177116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:38.177890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:38.178329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:38.193161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd HTTP/1.1 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:57:38.194717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.196281 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '811f414f-708a-4313-9909-6c6c4eaba7cd'} Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:38.197237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.198630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.200213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:38.200213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a88b5b4e-6edf-4505-ad12-a27eac6f160e tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 404 len: 111 microversion: 2.1 time: 0.031788 Jul 12 18:57:38.200213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 400/866] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:38 2022] DELETE /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 18:57:38.205190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:38.205803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 811f414f-708a-4313-9909-6c6c4eaba7cd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:38.211811 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:38.212255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:38.213016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:38.213453 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:38.227155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd HTTP/1.1 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:57:38.228838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.230342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '811f414f-708a-4313-9909-6c6c4eaba7cd'} Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:38.231242 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. Jul 12 18:57:38.233580 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:38.234826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 811f414f-708a-4313-9909-6c6c4eaba7cd could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:38.234826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b9fa2b1f-a94a-4227-9650-af801736f719 tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd" status: 404 len: 111 microversion: 2.1 time: 0.029442 Jul 12 18:57:38.234826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 467/867] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:38 2022] GET /compute/v2.1/servers/811f414f-708a-4313-9909-6c6c4eaba7cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:39.491673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:39.492223 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:39.499631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:39.500109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:39.500892 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:39.501335 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:39.515200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea HTTP/1.1 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:57:39.518504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.520163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '79956b08-375e-45c0-8616-a59bdbe15dea'} Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:39.521077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.522983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.524458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:39.524458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dbc67d50-dfe3-4e36-9f76-6160a6d5a81c tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 404 len: 111 microversion: 2.1 time: 0.030665 Jul 12 18:57:39.524458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 401/868] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:57:39 2022] DELETE /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:39.526770 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:39.527412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] [instance: 79956b08-375e-45c0-8616-a59bdbe15dea] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:57:39.533887 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:39.534379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:39.535138 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:57:39.535632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:57:39.549504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] HTTP exception thrown: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Request method failure captured: Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea HTTP/1.1 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHgfoX7qNk83FzVWfe4-dDkQPKLxex_smxQJhiWKMRLOQnw1CzkShW4Bbj3t1o3SU5wV2y9XoK-tU_b7AJeymNp9pHWHU1GVa2uxa9UgRJb-a8zyq9w9fpTtmasW02Lw2b4erlycV6_miEQ_Gd3cWmmmBE26FosFuk1rrWPs5FlYa8 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:57:39.551053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_2b14300d453444a582d224fcee029d2d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/2b14300d453444a582d224fcee029d2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/2b14300d453444a582d224fcee029d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 2b14300d453444a582d224fcee029d2d Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-524181771 Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 26993e3a077449da9c71fa7f1023a1e7 Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeTestJSON-524181771-project Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.552702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '79956b08-375e-45c0-8616-a59bdbe15dea'} Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:57:39.553627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. Jul 12 18:57:39.555005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:57:39.556151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] Returning 404 to user: Instance 79956b08-375e-45c0-8616-a59bdbe15dea could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:57:39.556151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-91abad29-be4b-477e-8552-67c4a0e18fda tempest-AttachVolumeTestJSON-524181771 tempest-AttachVolumeTestJSON-524181771-project] 10.222.0.59 "GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea" status: 404 len: 111 microversion: 2.1 time: 0.029751 Jul 12 18:57:39.556151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 468/869] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:57:39 2022] GET /compute/v2.1/servers/79956b08-375e-45c0-8616-a59bdbe15dea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:57:46.934116 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a3b6d494-5aa1-4770-b25e-0829d4ffbdf1 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01782ae8b0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:46.984031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a3b6d494-5aa1-4770-b25e-0829d4ffbdf1 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/2d052f0c-9ba9-4b52-ab64-00aa0f184d67" status: 200 len: 350 microversion: 2.1 time: 0.054214 Jul 12 18:57:46.984597 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 402/870] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:57:46 2022] GET /compute/v2.1/os-volumes/2d052f0c-9ba9-4b52-ab64-00aa0f184d67 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:48.612522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4087d014-0afc-45b1-99fa-08faca4880ce tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f0178576670>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:48.661667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4087d014-0afc-45b1-99fa-08faca4880ce tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/d1d42088-cbc0-4d4f-bfa5-d7ddb1671ba0" status: 200 len: 350 microversion: 2.1 time: 0.052994 Jul 12 18:57:48.662254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 469/871] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:57:48 2022] GET /compute/v2.1/os-volumes/d1d42088-cbc0-4d4f-bfa5-d7ddb1671ba0 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:51.321837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:51.322670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:51.327022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e8b14245-3810-46d0-8b00-6f81c0bc0b15 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01781f6790>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:51.485955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e8b14245-3810-46d0-8b00-6f81c0bc0b15 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/2405a1c9-9e6f-4e2d-b1e8-85dacc31e1a1" status: 200 len: 351 microversion: 2.1 time: 0.165478 Jul 12 18:57:51.486525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 403/872] 10.222.0.59 () {58 vars in 1244 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes/2405a1c9-9e6f-4e2d-b1e8-85dacc31e1a1 => generated 351 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:51.494372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:51.495116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:57:51.499551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f8bd1ce3-012a-417e-8e66-285f7be09bcc tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01783ece50>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:51.629616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f8bd1ce3-012a-417e-8e66-285f7be09bcc tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.135845 Jul 12 18:57:51.630174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 470/873] 10.222.0.59 () {58 vars in 1133 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:51.643043 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4a08c2c0-4726-4b4a-b404-184cb793eca8 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01782eb160>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:51.725586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4a08c2c0-4726-4b4a-b404-184cb793eca8 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087050 Jul 12 18:57:51.726181 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 404/874] 10.222.0.59 () {58 vars in 1148 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:51.737816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1e4caed9-f1d2-41ff-ad91-67e86c2b2ffa tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01783ecb80>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:51.822082 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1e4caed9-f1d2-41ff-ad91-67e86c2b2ffa tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087915 Jul 12 18:57:51.822673 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 471/875] 10.222.0.59 () {58 vars in 1133 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:51.835242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fcefdbae-5a7e-487a-ae5a-f399cfc3e9f4 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01782aeca0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:51.918874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fcefdbae-5a7e-487a-ae5a-f399cfc3e9f4 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087774 Jul 12 18:57:51.919702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 405/876] 10.222.0.59 () {58 vars in 1166 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:51.932359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-571ce2e8-e951-4b5a-a2dc-52559f2670e2 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f017838f820>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:52.017502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-571ce2e8-e951-4b5a-a2dc-52559f2670e2 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088856 Jul 12 18:57:52.018079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 472/877] 10.222.0.59 () {58 vars in 1169 bytes} [Tue Jul 12 18:57:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:52.031114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-07bcf8e1-4fa7-441c-956c-e091dab6031a tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01781f6160>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:52.111340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-07bcf8e1-4fa7-441c-956c-e091dab6031a tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084774 Jul 12 18:57:52.111954 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 406/878] 10.222.0.59 () {58 vars in 1154 bytes} [Tue Jul 12 18:57:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:57:52.123902 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-83341118-0add-4f38-91bd-0b9268f09a58 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f017836e8b0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:52.202833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-83341118-0add-4f38-91bd-0b9268f09a58 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083368 Jul 12 18:57:52.203441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 473/879] 10.222.0.59 () {58 vars in 1187 bytes} [Tue Jul 12 18:57:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:57:52.215497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7c7b7ca9-9cd9-4252-a709-a2a5921f5329 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] Calling method '.version_select at 0x7f01781f6ca0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:57:52.294757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7c7b7ca9-9cd9-4252-a709-a2a5921f5329 tempest-VolumesTestJSON-736142197 tempest-VolumesTestJSON-736142197-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.083461 Jul 12 18:57:52.295894 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 407/880] 10.222.0.59 () {58 vars in 1154 bytes} [Tue Jul 12 18:57:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:01.683207 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:58:01.683873 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 18:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:58:04.975946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 18:58:04.976539 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 18:58:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 18:58:08.894401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:08.895588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:08.902623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:08.903072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:08.903870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:08.904616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:08.940876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d8bcde8b-1fdd-438c-b88c-a4faad4319ef tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051218 Jul 12 18:58:08.941482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 474/881] 10.222.0.59 () {60 vars in 1342 bytes} [Tue Jul 12 18:58:08 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:09.002212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:09.007126 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:09.010084 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:09.010547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:09.011335 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:09.011782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:09.038169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:58:09.331712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-891cd59b-e9e8-48f5-883c-e6a39f55e23d tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 204 len: 0 microversion: 2.20 time: 0.334021 Jul 12 18:58:09.332301 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 408/882] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Jul 12 18:58:08 2022] DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:58:09.341486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:09.342101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:09.348279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:09.348725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:09.350277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:09.350740 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:09.531870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:09.540937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:09.542452 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:09.543646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e470fa06-e56d-4996-8909-08b320d85644 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.206032 Jul 12 18:58:09.544236 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 475/883] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:09 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:58:10.564323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:10.565027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:10.572485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:10.572485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:10.572751 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:10.573185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:10.775653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:10.784396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:10.786030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:10.788421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d0331d1b-e199-4cd2-8bf5-1b7547a8b4d5 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.228598 Jul 12 18:58:10.788985 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 409/884] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:10 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:58:11.806405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:11.807139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:11.813967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:11.815194 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:11.815680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:11.816187 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:12.057278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:12.073755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:12.080050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:12.081381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-175cd305-876c-4b6b-a7bf-5b0d225128f7 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1723 microversion: 2.20 time: 0.279242 Jul 12 18:58:12.083807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 476/885] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:11 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:58:12.533273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-7520fe6e-6047-45b8-a4cd-912c50e27e6d req-bafe7086-50ae-4ad7-9e42-f853958e13ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dddcf1b-5875-4418-915d-79802a91a6f3", "name": "network-vif-deleted", "tag": "3bdaa84f-c083-402a-b14f-c85ed454130c"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:12.553462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-7520fe6e-6047-45b8-a4cd-912c50e27e6d req-bafe7086-50ae-4ad7-9e42-f853958e13ef service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:12.553928 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-7520fe6e-6047-45b8-a4cd-912c50e27e6d req-bafe7086-50ae-4ad7-9e42-f853958e13ef service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:12.568716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-7520fe6e-6047-45b8-a4cd-912c50e27e6d req-bafe7086-50ae-4ad7-9e42-f853958e13ef service nova] Creating event network-vif-deleted:3bdaa84f-c083-402a-b14f-c85ed454130c for instance 1dddcf1b-5875-4418-915d-79802a91a6f3 on hv-cinder-83538 Jul 12 18:58:12.573832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-7520fe6e-6047-45b8-a4cd-912c50e27e6d req-bafe7086-50ae-4ad7-9e42-f853958e13ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044512 Jul 12 18:58:12.574465 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 410/886] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:13.102833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:13.104428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:13.131535 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:13.135431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:13.135431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:13.135431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:13.185435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:13.186635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:13.187110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lazy-loading 'fault' on Instance uuid 1dddcf1b-5875-4418-915d-79802a91a6f3 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:58:13.243949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:13.259327 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:13.277418 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08ded0d15f774b2f8a63f9bcbe0f8743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2be77c6adbb48db9d2ddffe91cb1496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:13.281753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2edd58df-a891-4a2f-a83e-f44c7a1b95a9 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 200 len: 1370 microversion: 2.20 time: 0.186008 Jul 12 18:58:13.292683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 477/887] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:13 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 12 18:58:14.306386 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:14.307370 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:14.322089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:14.324155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:14.325091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:14.329247 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:14.363904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 HTTP/1.1 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:58:14.387658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:14.389441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '1dddcf1b-5875-4418-915d-79802a91a6f3'} Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:14.390356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:14.392046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:14.393485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:14.393485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-58004ba9-a3f8-4b1b-9118-c242cdad5c0e tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 404 len: 111 microversion: 2.20 time: 0.068139 Jul 12 18:58:14.393485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 411/888] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:14 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:58:14.393733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7a211a26-10af-4ab6-a944-2696c9b91fae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '.version_select at 0x7f0178371ee0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:14.486837 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7a211a26-10af-4ab6-a944-2696c9b91fae tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349192338" status: 204 len: 0 microversion: 2.20 time: 0.097873 Jul 12 18:58:14.487826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 478/889] 10.222.0.59 () {60 vars in 1258 bytes} [Tue Jul 12 18:58:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349192338 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 12 18:58:16.661682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:16.662141 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:16.669140 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:16.669855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:16.670756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:16.671255 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:16.686793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 HTTP/1.1 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:58:16.688890 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.690451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '1dddcf1b-5875-4418-915d-79802a91a6f3'} Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:16.691291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.700865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.702363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:16.702363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f2463040-b8c8-416d-b71c-f0f8187c6a74 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 404 len: 111 microversion: 2.20 time: 0.038347 Jul 12 18:58:16.702363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 412/890] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Jul 12 18:58:16 2022] DELETE /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:58:16.705687 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:16.706309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: 1dddcf1b-5875-4418-915d-79802a91a6f3] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:16.713615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:16.714154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:16.714996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:16.715530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:16.733149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 HTTP/1.1 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:58:16.735160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.737030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '1dddcf1b-5875-4418-915d-79802a91a6f3'} Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:16.737954 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. Jul 12 18:58:16.740030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:16.741836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance 1dddcf1b-5875-4418-915d-79802a91a6f3 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:16.741836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c5794636-a6ed-4019-a812-bd19fe4c48db tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3" status: 404 len: 111 microversion: 2.20 time: 0.037529 Jul 12 18:58:16.743021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 479/891] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:16 2022] GET /compute/v2.1/servers/1dddcf1b-5875-4418-915d-79802a91a6f3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:58:18.134241 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:18.134802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:18.153411 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:18.153885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:18.154692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:18.155709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:18.189615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 HTTP/1.1 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:58:18.191424 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.193451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'a96074e1-9b57-4f07-8745-60c7e8446aa9'} Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:18.194314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.195935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.198777 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:18.198777 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6b8ac5fd-e7ab-421a-abbc-c755eb9a044b tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 404 len: 111 microversion: 2.20 time: 0.066370 Jul 12 18:58:18.203944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 413/892] 10.222.0.59 () {60 vars in 1279 bytes} [Tue Jul 12 18:58:18 2022] DELETE /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:58:18.213818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:18.214456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] [instance: a96074e1-9b57-4f07-8745-60c7e8446aa9] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:18.222001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:18.222693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:18.225362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:18.226617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:18.277816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] HTTP exception thrown: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Request method failure captured: Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 HTTP/1.1 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcHjZUKqg3sP8pwsLrdfdL9fpBAPOyrT69sCznV_v4113sIAeckl8z5t0sV2nVlt5_ru3XygFFho7T3u1j0RDNsVpfmJndRA_85bPlWR-e9vpOmuakvOCbidv7oyv7OYKNfwaufZBdH9cEpeo8m0JZFMu3VPMtVFcqZakjpBrZhit8Q Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Openstack-Nova-Api-Version: 2.20 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:58:18.280928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a2be77c6adbb48db9d2ddffe91cb1496", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a2be77c6adbb48db9d2ddffe91cb1496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: a2be77c6adbb48db9d2ddffe91cb1496 Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1420407721 Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 08ded0d15f774b2f8a63f9bcbe0f8743 Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1420407721-project Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.282678 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'a96074e1-9b57-4f07-8745-60c7e8446aa9'} Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:18.287706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. Jul 12 18:58:18.289203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:58:18.290491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] Returning 404 to user: Instance a96074e1-9b57-4f07-8745-60c7e8446aa9 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:18.290491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d6888ad0-5c34-466c-b570-5c178cb31e32 tempest-AttachVolumeShelveTestJSON-1420407721 tempest-AttachVolumeShelveTestJSON-1420407721-project] 10.222.0.59 "GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9" status: 404 len: 111 microversion: 2.20 time: 0.075551 Jul 12 18:58:18.290491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 480/893] 10.222.0.59 () {60 vars in 1276 bytes} [Tue Jul 12 18:58:18 2022] GET /compute/v2.1/servers/a96074e1-9b57-4f07-8745-60c7e8446aa9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 12 18:58:22.738953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8e408411-3a83-46ca-b727-477362283e2f tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Action: 'create', calling method: .version_select at 0x7f0178312550>, body: {"keypair": {"name": "tempest-TestShelveInstance-286659698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVLEpSsmUNZFGukke3pEvL3A7FqxKGoU8+l4eSKrVUaq19LeDvcPlY3Udvz/3KBQ687wHZ86qo0/Nqd/yzAjzMmJ3PNkuqWIBRMJNMEXY89wv14BtuLiAo191fwMFJjfQ=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:22.771737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-8e408411-3a83-46ca-b727-477362283e2f tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Getting quotas for project c708b3a3006049469e7379b68d7b9e94. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:22.784431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-8e408411-3a83-46ca-b727-477362283e2f tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Getting quotas for user aaf2b0ab2f9f4d939c22754c0c64efd2 and project c708b3a3006049469e7379b68d7b9e94. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:22.880820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8e408411-3a83-46ca-b727-477362283e2f tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.423144 Jul 12 18:58:22.887626 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 414/894] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:58:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:31.495854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1518387936", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "networks": [{"uuid": "de5ed315-4b20-4467-99bb-7c9cf070a21c"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:31.507659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:31.508266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=30 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:31.560419 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] validate_networks() for [('de5ed315-4b20-4467-99bb-7c9cf070a21c', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:58:32.212938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:58:32.216641 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:58:32.217457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:58:32.218088 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:58:32.218321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:58:32.229064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:32.230183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:32.231941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:32.238964 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:32.260659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Getting quotas for project bb0905c39dff4c479c49929445fec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:32.277172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Getting quotas for user 26100386121440288ffafe02ead22bd0 and project bb0905c39dff4c479c49929445fec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:32.294053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:58:32.296649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:58:32.470801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-72e7d8b5-dba3-414c-9ba6-0bf8fd3395d6 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979374 Jul 12 18:58:32.472213 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 481/895] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:58:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:58:32.480437 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:32.487948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9337dd5f-e625-49a9-8d9c-f4ad23045041 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:32.487948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9337dd5f-e625-49a9-8d9c-f4ad23045041 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:32.577253 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9337dd5f-e625-49a9-8d9c-f4ad23045041 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:32.586028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9337dd5f-e625-49a9-8d9c-f4ad23045041 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1214 microversion: 2.1 time: 0.106815 Jul 12 18:58:32.587364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 415/896] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:32 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:32.819071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ea0a7b28-a8a2-44d4-b635-a9d947471595 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: .version_select at 0x7f01783580d0>, body: {"keypair": {"name": "tempest-keypair-139301657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9KFecogkpI9mF7gnUxClHwZZatsMAhxX51bYCuVKhGi4UbGPWxT+lXTC5FcGIttdg5f4c0QRm3OU6m5wrrsGxNj7WK233QSrRcJ2RQ8uuNM7uYXHVj45ank9nxI4JL2g=="}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:32.838165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-ea0a7b28-a8a2-44d4-b635-a9d947471595 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:32.851620 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-ea0a7b28-a8a2-44d4-b635-a9d947471595 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:32.944378 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ea0a7b28-a8a2-44d4-b635-a9d947471595 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259547 Jul 12 18:58:32.944987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 482/897] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 18:58:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:33.603612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e61ad581-d770-48c2-a340-604d4b219e60 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:33.604333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e61ad581-d770-48c2-a340-604d4b219e60 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:33.682612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e61ad581-d770-48c2-a340-604d4b219e60 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:33.689477 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e61ad581-d770-48c2-a340-604d4b219e60 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1214 microversion: 2.1 time: 0.090074 Jul 12 18:58:33.692689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 416/898] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:33 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:34.709652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:34.710847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:34.722694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:34.723207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:34.725067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:34.725795 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:34.847547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:34.876785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9dea06e2-e893-466f-9b8b-3a502e9868bc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1266 microversion: 2.1 time: 0.173075 Jul 12 18:58:34.881885 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 483/899] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:34 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:35.904968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:35.906160 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:35.914031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:35.914482 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:35.915264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:35.915921 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:36.009629 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:36.019903 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6f8b8e68-2bec-4ff1-ad93-1fa5d1320276 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1272 microversion: 2.1 time: 0.119890 Jul 12 18:58:36.021458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 417/900] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:35 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:36.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-916130733", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae8b0f6-4fda-4639-886a-ca703e1b912a"}], "security_groups": [{"name": "tempest-securitygroup--1931606468"}], "key_name": "tempest-keypair-139301657", "user_data": "}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:36.264681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] validate_networks() for [('cae8b0f6-4fda-4639-886a-ca703e1b912a', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:58:36.820933 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:58:36.821359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:58:36.821833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:58:36.822227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:58:36.822628 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:58:36.831411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:36.831925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:36.832791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:36.833728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:36.853405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:36.857551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:36.868652 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:58:36.870878 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:58:36.996944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2aa87c86-d96d-40bb-a2ee-4ab8c270c22a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.895976 Jul 12 18:58:36.997995 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 484/901] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:58:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:58:37.009841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-94342c6c-6317-4ac8-8e68-ab5a2d521acb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:37.010456 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-94342c6c-6317-4ac8-8e68-ab5a2d521acb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:37.037312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:37.037928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:37.051005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:37.052203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:37.053514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:37.054726 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:37.100941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-94342c6c-6317-4ac8-8e68-ab5a2d521acb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:37.107895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-94342c6c-6317-4ac8-8e68-ab5a2d521acb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1240 microversion: 2.1 time: 0.103952 Jul 12 18:58:37.109011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 418/902] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:37 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:37.272645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:37.281189 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-57a502d7-8dd3-4658-8d68-cb13c42875dd tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.248113 Jul 12 18:58:37.281788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 485/903] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:37 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:37.681204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-0a42e95d-656a-4a2a-b279-925aeeda8f0a req-24711ccb-00b0-4724-925a-54245b2250e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f244b79d-8a2c-4d52-8fa5-508af60444dd", "tag": "fe5638bc-bb17-4551-afcb-e35dea4eba31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:37.701197 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-0a42e95d-656a-4a2a-b279-925aeeda8f0a req-24711ccb-00b0-4724-925a-54245b2250e8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:37.701653 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-0a42e95d-656a-4a2a-b279-925aeeda8f0a req-24711ccb-00b0-4724-925a-54245b2250e8 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:37.713828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-0a42e95d-656a-4a2a-b279-925aeeda8f0a req-24711ccb-00b0-4724-925a-54245b2250e8 service nova] Creating event network-changed:fe5638bc-bb17-4551-afcb-e35dea4eba31 for instance f244b79d-8a2c-4d52-8fa5-508af60444dd on hv-cinder-83538 Jul 12 18:58:37.719131 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-0a42e95d-656a-4a2a-b279-925aeeda8f0a req-24711ccb-00b0-4724-925a-54245b2250e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042705 Jul 12 18:58:37.719852 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 419/904] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:38.126216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:38.126891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:38.134412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:38.134866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:38.135694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:38.136131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:38.228177 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:38.235751 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-caab5cec-233d-41f6-bca6-5ad754b37b22 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1244 microversion: 2.1 time: 0.113609 Jul 12 18:58:38.236337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 486/905] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:38 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:38.299638 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:38.300348 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:38.307102 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:38.307584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:38.308365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:38.308801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:38.550021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:38.558827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-98520a48-d950-4d32-a551-faad07e7edb0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.263880 Jul 12 18:58:38.559453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 420/906] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:38 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:39.252554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:39.253161 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:39.260187 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:39.260633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:39.261389 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:39.261823 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:39.322579 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:39.329773 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2ee5cf93-f1b4-410f-a51f-3817f030b3d0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1292 microversion: 2.1 time: 0.081028 Jul 12 18:58:39.330330 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 487/907] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:39 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:39.576401 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:39.576935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:39.578893 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:39.583862 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:39.584315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:39.585073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:39.585541 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:39.728359 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:39.735812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8afdc4af-0048-410e-887b-e80497527456 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.163494 Jul 12 18:58:39.736381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 421/908] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:39 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:40.346103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:40.346711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:40.353279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:40.353728 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:40.354482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:40.354916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:40.416165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:40.424003 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e5576ab4-e134-4213-b1cb-ed2ab9574f29 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1292 microversion: 2.1 time: 0.081682 Jul 12 18:58:40.424667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 488/909] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:40 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:40.754169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:40.755571 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:40.762557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:40.767762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:40.767762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:40.767762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:40.892964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:40.900324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c306f159-868b-4a1d-aac3-f91834bcef2c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.150227 Jul 12 18:58:40.900886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 422/910] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:40 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:41.441094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:41.441699 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:41.449498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:41.449942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:41.450699 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:41.451124 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:41.516483 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:41.524836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-374f9dcb-fb9c-47e1-a301-c6ab7c08786d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1292 microversion: 2.1 time: 0.087682 Jul 12 18:58:41.525407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 489/911] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:41 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:41.917639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:41.918261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:41.925103 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:41.931702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:41.931702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:41.931702 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:42.091168 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:42.099177 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-42f25a39-9a7f-42ab-89c0-a22c64e4a082 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.184929 Jul 12 18:58:42.099815 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 423/912] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:41 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:42.542473 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:42.543074 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:42.549889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:42.550340 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:42.551137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:42.552662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:42.727112 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:42.734980 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-75b8bfb8-f34e-4ac0-a060-f865c30570f3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.196387 Jul 12 18:58:42.735519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 490/913] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:42 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:58:43.117115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:43.117955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:43.124549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:43.125295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:43.126149 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:43.126664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:43.276078 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:43.283916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1b068b96-4f94-402b-a3cb-83766d22c65a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.171509 Jul 12 18:58:43.284447 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 424/914] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:43 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:43.582152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-70afe597-6edc-4b49-9a91-159cfec928f3 req-5542734d-39da-4ce0-addd-8b22ffc9003c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c043ae0-a1b7-4574-a5c2-9525063c3229", "tag": "ae6e5b62-8b06-4b04-846a-c2094b9d7ef4"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:43.593201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-70afe597-6edc-4b49-9a91-159cfec928f3 req-5542734d-39da-4ce0-addd-8b22ffc9003c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:43.593804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-70afe597-6edc-4b49-9a91-159cfec928f3 req-5542734d-39da-4ce0-addd-8b22ffc9003c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:43.612518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-70afe597-6edc-4b49-9a91-159cfec928f3 req-5542734d-39da-4ce0-addd-8b22ffc9003c service nova] Creating event network-changed:ae6e5b62-8b06-4b04-846a-c2094b9d7ef4 for instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 on hv-cinder-83538 Jul 12 18:58:43.613831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-70afe597-6edc-4b49-9a91-159cfec928f3 req-5542734d-39da-4ce0-addd-8b22ffc9003c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037467 Jul 12 18:58:43.614645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 491/915] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:43.757238 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:43.757919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:43.764485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:43.764941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:43.765712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:43.766148 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:43.979738 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:43.987586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-30643120-aae4-4d47-b9bd-d5fabce903a8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.234823 Jul 12 18:58:43.988381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 425/916] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:43 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:44.301173 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:44.301911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:44.308463 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:44.308903 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:44.309666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:44.310094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:44.544018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-86dd026a-0091-4580-aece-05a78a69f24b req-1c1c17aa-82a9-4fc4-b0ca-165a0633486b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f244b79d-8a2c-4d52-8fa5-508af60444dd", "name": "network-vif-plugged", "status": "completed", "tag": "fe5638bc-bb17-4551-afcb-e35dea4eba31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:44.553955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-86dd026a-0091-4580-aece-05a78a69f24b req-1c1c17aa-82a9-4fc4-b0ca-165a0633486b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:44.555109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-86dd026a-0091-4580-aece-05a78a69f24b req-1c1c17aa-82a9-4fc4-b0ca-165a0633486b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:44.566530 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-86dd026a-0091-4580-aece-05a78a69f24b req-1c1c17aa-82a9-4fc4-b0ca-165a0633486b service nova] Creating event network-vif-plugged:fe5638bc-bb17-4551-afcb-e35dea4eba31 for instance f244b79d-8a2c-4d52-8fa5-508af60444dd on hv-cinder-83538 Jul 12 18:58:44.572709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-86dd026a-0091-4580-aece-05a78a69f24b req-1c1c17aa-82a9-4fc4-b0ca-165a0633486b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032197 Jul 12 18:58:44.573244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 426/917] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:44.648168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:44.657332 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-68540f71-d471-4c52-87fd-5b145736f07a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.360427 Jul 12 18:58:44.658718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 492/918] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:44 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:45.005089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:45.005789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:45.012035 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:45.012761 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:45.013533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:45.013969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:45.141782 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:45.149727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-19bdba60-d1c1-4cb3-9ce2-8d6602118522 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.149038 Jul 12 18:58:45.150288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 427/919] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:44 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:45.674636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:45.675281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:45.682306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:45.682755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:45.683542 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:45.683981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:45.811551 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:45.819755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6b3d52ad-438a-4a7a-912d-5a8c0495577f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.149074 Jul 12 18:58:45.820316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 493/920] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:45 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:46.165870 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:46.166497 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:46.173162 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:46.173604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:46.174353 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:46.174833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:46.308026 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:46.315622 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-22966ace-47af-48a6-b0cd-084c0a73ba52 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.153552 Jul 12 18:58:46.316195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 428/921] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:46 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:46.838931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:46.839591 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:46.842266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=4 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:46.847833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:46.849303 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:46.850167 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:46.850605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:46.868080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=16 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:47.007801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:47.015363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-27618cf4-4ba0-4d6b-a1a1-c508a55c71d0 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.181271 Jul 12 18:58:47.015927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 494/922] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:46 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:58:47.333042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:47.333703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:47.336338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=10 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:47.341615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:47.342064 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:47.342834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:47.343278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:47.477409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:47.484942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-08284246-6cfa-4700-bfac-a7153ba014a6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.155792 Jul 12 18:58:47.485526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 429/923] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:47 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:48.036593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:48.036593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:48.040918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:48.041372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:48.042186 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:48.042623 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:48.172322 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:48.180919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f1050a79-9a55-4888-a2c1-26e03689dfc4 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.151803 Jul 12 18:58:48.181488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 495/924] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:48 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:48.502409 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:48.505853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:48.509546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:48.509988 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:48.510819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:48.511244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:48.652365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:48.659942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-64cad7be-9601-4912-844c-4c223e5d0b6b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.161604 Jul 12 18:58:48.660506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 430/925] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:48 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:49.197711 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:49.198284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:49.204794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:49.205243 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:49.206005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:49.206440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:49.335867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:49.343212 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bfdac62e-2009-4ede-8230-595ab56f040e tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1314 microversion: 2.1 time: 0.149395 Jul 12 18:58:49.343819 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 496/926] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:49 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:49.676776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:49.677918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:49.683865 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:49.684314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:49.685073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:49.685509 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:49.833149 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:49.840690 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e3344b8d-2634-4b9e-aa8f-19839cab9a00 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.168441 Jul 12 18:58:49.841251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 431/927] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:49 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:50.361001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:50.361651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:50.369443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:50.369889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:50.370656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:50.371092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:50.453743 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-255588667", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-286659698", "security_groups": [{"name": "tempest-secgroup-smoke-690546025"}], "networks": [{"uuid": "5cf099c9-ae8f-4d25-9167-c17bce3a48d8"}], "block_device_mapping_v2": [{"uuid": "09f75330-fd58-448b-9479-3e36e4be37bc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:50.527393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:50.538135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-67a5f280-00f6-49ed-bd08-9b8a68563c25 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1497 microversion: 2.1 time: 0.181231 Jul 12 18:58:50.539421 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 497/928] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:50 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:50.570071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-63b39f6b-1f4d-442c-acc3-134817ff125c req-f5fe5557-511b-442f-917c-8cc0891f4174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c043ae0-a1b7-4574-a5c2-9525063c3229", "name": "network-vif-plugged", "status": "completed", "tag": "ae6e5b62-8b06-4b04-846a-c2094b9d7ef4"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:50.581020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-63b39f6b-1f4d-442c-acc3-134817ff125c req-f5fe5557-511b-442f-917c-8cc0891f4174 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:50.581831 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-63b39f6b-1f4d-442c-acc3-134817ff125c req-f5fe5557-511b-442f-917c-8cc0891f4174 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:50.593196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] validate_networks() for [('5cf099c9-ae8f-4d25-9167-c17bce3a48d8', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:58:50.596340 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-63b39f6b-1f4d-442c-acc3-134817ff125c req-f5fe5557-511b-442f-917c-8cc0891f4174 service nova] Creating event network-vif-plugged:ae6e5b62-8b06-4b04-846a-c2094b9d7ef4 for instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 on hv-cinder-83538 Jul 12 18:58:50.602477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-63b39f6b-1f4d-442c-acc3-134817ff125c req-f5fe5557-511b-442f-917c-8cc0891f4174 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043427 Jul 12 18:58:50.610005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 498/929] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:50.858904 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:50.859549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:50.866217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:50.866370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:50.867113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:50.867588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.103927 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:58:51.104432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:58:51.105091 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:58:51.106012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:58:51.106504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:58:51.115666 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.116133 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.117039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.117677 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.136219 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Getting quotas for project c708b3a3006049469e7379b68d7b9e94. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:51.140912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Getting quotas for user aaf2b0ab2f9f4d939c22754c0c64efd2 and project c708b3a3006049469e7379b68d7b9e94. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:51.151182 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:51.158550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0018d745-35b7-4e78-b4df-4fcdc1b324be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.304151 Jul 12 18:58:51.159123 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 499/930] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:50 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:58:51.200102 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:58:51.202451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09f75330-fd58-448b-9479-3e36e4be37bc',volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:58:51.394822 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:51.395686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:51.401904 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.402340 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.403092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.403550 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.428730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:58:51.442741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=100 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:51.688113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e71b03e6-090a-44a7-aa01-d3563b5e9342 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.238091 Jul 12 18:58:51.688975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 432/931] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:58:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 12 18:58:51.706764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-86edb4a7-1c9c-4242-ac3c-b4c0f9af8718 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:51.712652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-86edb4a7-1c9c-4242-ac3c-b4c0f9af8718 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:51.729857 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8404488b-8319-415d-a98a-373a7351b705 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 204 len: 0 microversion: 2.1 time: 0.338443 Jul 12 18:58:51.730655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 500/932] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:58:51 2022] DELETE /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 18:58:51.743346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:51.744061 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:51.750184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.750635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.751681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:51.752168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:51.770387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-86edb4a7-1c9c-4242-ac3c-b4c0f9af8718 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:51.792039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-86edb4a7-1c9c-4242-ac3c-b4c0f9af8718 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1087 microversion: 2.1 time: 0.082966 Jul 12 18:58:51.792039 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 433/933] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:51 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:58:51.889828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:51.897875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-36ac6e6c-d9cd-4a79-9e52-08a6ed82f938 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1503 microversion: 2.1 time: 0.159561 Jul 12 18:58:51.898443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 501/934] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:51 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:52.175414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:52.176044 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:52.182730 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.186428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:52.186428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.186428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:52.318040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:52.325552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-03b75805-61a9-492a-9f9e-3e6fd0557f5b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.154206 Jul 12 18:58:52.326113 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 434/935] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:52 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:52.799435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:52.800052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:52.806629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.807072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:52.807906 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.808346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:52.868161 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:52.875891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a4ef1c8b-e8a2-4e9c-abd1-8262df78ed75 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1137 microversion: 2.1 time: 0.080449 Jul 12 18:58:52.876456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 502/936] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:52 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:52.914746 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:52.915274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:52.921945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.922388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:52.923194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:52.923650 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:53.058419 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:53.065759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-170c6283-7e60-47ca-bee0-08f8b52ecdbc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1503 microversion: 2.1 time: 0.155498 Jul 12 18:58:53.066309 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 435/937] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:52 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:53.341875 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:53.342499 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:53.349372 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:53.349907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:53.350672 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:53.351101 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:53.488054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:53.495753 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-371bd4c7-3766-47e5-b6d5-7be83797125d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1366 microversion: 2.1 time: 0.157644 Jul 12 18:58:53.496321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 503/938] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:53 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:53.893232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:53.893953 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:53.900812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:53.901260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:53.902025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:53.902462 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:53.962346 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:53.969882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e977612a-5c48-46c2-b630-b7fac3461e51 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1137 microversion: 2.1 time: 0.080512 Jul 12 18:58:53.970454 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 436/939] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:53 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:54.083475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:54.084155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:54.090562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.091010 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.091804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.092283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.289960 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:54.297439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d733b5d5-bb4c-4774-ac8c-fd7ddb700ef9 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1503 microversion: 2.1 time: 0.217955 Jul 12 18:58:54.298247 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 504/940] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:54 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:54.512960 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:54.513567 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:54.519614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.521256 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.522062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.522514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.542013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:54.674449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:54.682310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-514bdbae-9946-4355-87b1-9bc738b9e59a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1555 microversion: 2.1 time: 0.173522 Jul 12 18:58:54.682879 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 437/941] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:54 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:54.699602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:54.700097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:54.706108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.706539 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.707359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.708349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.810226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-62f36e88-8d66-49d0-a115-cb3d0e150a44 req-b6206f5f-faf1-4455-9f22-84c488242922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f244b79d-8a2c-4d52-8fa5-508af60444dd", "name": "network-vif-deleted", "tag": "fe5638bc-bb17-4551-afcb-e35dea4eba31"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:54.819525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-62f36e88-8d66-49d0-a115-cb3d0e150a44 req-b6206f5f-faf1-4455-9f22-84c488242922 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.825805 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-62f36e88-8d66-49d0-a115-cb3d0e150a44 req-b6206f5f-faf1-4455-9f22-84c488242922 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.831183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c7ca6070-54a9-42ef-a598-c5adc5bf20ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135256 Jul 12 18:58:54.831364 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-62f36e88-8d66-49d0-a115-cb3d0e150a44 req-b6206f5f-faf1-4455-9f22-84c488242922 service nova] Creating event network-vif-deleted:fe5638bc-bb17-4551-afcb-e35dea4eba31 for instance f244b79d-8a2c-4d52-8fa5-508af60444dd on hv-cinder-83538 Jul 12 18:58:54.833118 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 505/942] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 18:58:54 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:54.842009 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-62f36e88-8d66-49d0-a115-cb3d0e150a44 req-b6206f5f-faf1-4455-9f22-84c488242922 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 Jul 12 18:58:54.842902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 438/943] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:54.987284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:54.988104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:54.994888 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.998348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:54.998348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:54.998348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:55.133897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:55.143942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d9b99b1b-7944-4eae-aee5-41332d30b4c4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1193 microversion: 2.1 time: 0.160394 Jul 12 18:58:55.145419 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 506/944] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:54 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1193 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:55.316455 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:55.317297 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:55.323942 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:55.324395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:55.325192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:55.325624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:55.356828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:55.357272 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:55.357716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lazy-loading 'fault' on Instance uuid f244b79d-8a2c-4d52-8fa5-508af60444dd {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:58:55.431407 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:55.438766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-afbac29f-9588-40d5-a39e-14d56adb2c9a tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 200 len: 1304 microversion: 2.1 time: 0.127117 Jul 12 18:58:55.439358 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 439/945] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:55 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:56.163594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:56.164565 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:56.167765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:58:56.171503 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:56.172005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:56.173227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:56.173227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:56.251491 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:56.259487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-a1ab6f75-acae-4c89-b7a2-51ddf6b0ff7b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1203 microversion: 2.1 time: 0.100758 Jul 12 18:58:56.260347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 507/946] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:56 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:56.456682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:56.457342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: f244b79d-8a2c-4d52-8fa5-508af60444dd] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:56.465245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:56.470192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:56.470192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:56.470192 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:56.480908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] HTTP exception thrown: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Request method failure captured: Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd HTTP/1.1 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRVXkuEEEXWv2fnbvezYa3z_fGRcKKB7Uv8t29xFaPgGktcZENetnmkSHaBQHdf-pGHY391S2Hcg9StsoZAYiI0Wod1JtDtBBzSeOZggkn9pRl-MQeGZpH4F6uTYwdNx-8pqvJHwPOL_hEyqVQzIDSjFyNjTyC2i-fwLD701Y2_H78 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: bb0905c39dff4c479c49929445fec3e3 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesActionsTest-1264813250 Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:58:56.482967 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bb0905c39dff4c479c49929445fec3e3", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesActionsTest-1264813250 Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: bb0905c39dff4c479c49929445fec3e3 Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesActionsTest-1264813250 Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesActionsTest-1264813250-project Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 26100386121440288ffafe02ead22bd0 Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesActionsTest-1264813250-project Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. Jul 12 18:58:56.484664 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'f244b79d-8a2c-4d52-8fa5-508af60444dd'} Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:58:56.485472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. Jul 12 18:58:56.486802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:58:56.490290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Returning 404 to user: Instance f244b79d-8a2c-4d52-8fa5-508af60444dd could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:58:56.491512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-103bc34b-5521-4d01-840e-806c78b0adad tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd" status: 404 len: 111 microversion: 2.1 time: 0.039280 Jul 12 18:58:56.492242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 440/947] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:56 2022] GET /compute/v2.1/servers/f244b79d-8a2c-4d52-8fa5-508af60444dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:58:56.547136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-456934716", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "networks": [{"uuid": "de5ed315-4b20-4467-99bb-7c9cf070a21c"}]}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:56.608366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] validate_networks() for [('de5ed315-4b20-4467-99bb-7c9cf070a21c', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:58:56.870188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-30bd662a-5528-44f2-b6ba-e7f528e453cf req-63044a2d-e1db-4a98-be6c-b4a732fbae88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c043ae0-a1b7-4574-a5c2-9525063c3229", "tag": "ae6e5b62-8b06-4b04-846a-c2094b9d7ef4"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:56.883204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-30bd662a-5528-44f2-b6ba-e7f528e453cf req-63044a2d-e1db-4a98-be6c-b4a732fbae88 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:56.883701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-30bd662a-5528-44f2-b6ba-e7f528e453cf req-63044a2d-e1db-4a98-be6c-b4a732fbae88 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:56.900156 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-30bd662a-5528-44f2-b6ba-e7f528e453cf req-63044a2d-e1db-4a98-be6c-b4a732fbae88 service nova] Creating event network-changed:ae6e5b62-8b06-4b04-846a-c2094b9d7ef4 for instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 on hv-cinder-83538 Jul 12 18:58:56.906290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-30bd662a-5528-44f2-b6ba-e7f528e453cf req-63044a2d-e1db-4a98-be6c-b4a732fbae88 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041157 Jul 12 18:58:56.907560 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 441/948] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:58:57.281435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:57.281435 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:57.288362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:57.289141 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:57.289260 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:58:57.289661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:58:57.290712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:57.290832 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:58:57.291164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:58:57.291615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:58:57.291949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:57.306220 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:57.306826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:57.307662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:57.308848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:57.332126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Getting quotas for project bb0905c39dff4c479c49929445fec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:58:57.338140 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Getting quotas for user 26100386121440288ffafe02ead22bd0 and project bb0905c39dff4c479c49929445fec3e3. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:58:57.351611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:58:57.355511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:58:57.550816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:57.558940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0988056f-5886-4b0d-a521-9525c61b6d7a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.284766 Jul 12 18:58:57.562146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 442/949] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:57 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:57.571820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-15cd8ad8-d78a-4e04-8638-5ecd583e3998 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028776 Jul 12 18:58:57.573047 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 508/950] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:58:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:58:57.583127 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-671cfbb6-1273-4295-be69-02311de7bd4d tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:57.583778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-671cfbb6-1273-4295-be69-02311de7bd4d tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:57.652513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-671cfbb6-1273-4295-be69-02311de7bd4d tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:57.661249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-671cfbb6-1273-4295-be69-02311de7bd4d tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1213 microversion: 2.1 time: 0.082047 Jul 12 18:58:57.661946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 443/951] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:57 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:58.577536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:58.578062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:58.585771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:58.586230 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:58.587002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:58.587473 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:58.678513 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:58.679130 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:58.686876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:58.687806 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:58.688604 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:58.689053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:58.728484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:58.736068 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-122b36b4-bd2d-433a-a738-58fcc1953af6 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.163060 Jul 12 18:58:58.736634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 509/952] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:58 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:58:58.761932 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:58.769153 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4b05bf07-9903-4c42-921f-6a83e1f0df21 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1217 microversion: 2.1 time: 0.094975 Jul 12 18:58:58.770222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 444/953] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:58 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1217 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:58:58.936058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-ab7b245c-a83f-4c34-b061-2f4287b30a30 req-e2d5788c-8565-40ef-9fe7-c064c2885b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:58:58.944966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ab7b245c-a83f-4c34-b061-2f4287b30a30 req-e2d5788c-8565-40ef-9fe7-c064c2885b7e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:58.945411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ab7b245c-a83f-4c34-b061-2f4287b30a30 req-e2d5788c-8565-40ef-9fe7-c064c2885b7e service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:58.955996 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-ab7b245c-a83f-4c34-b061-2f4287b30a30 req-e2d5788c-8565-40ef-9fe7-c064c2885b7e service nova] Creating event network-changed:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 18:58:58.961804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-ab7b245c-a83f-4c34-b061-2f4287b30a30 req-e2d5788c-8565-40ef-9fe7-c064c2885b7e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029329 Jul 12 18:58:58.962380 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 510/954] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:58:59.753094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:59.753697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:59.760939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:59.762178 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:59.763150 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:59.764060 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:59.788229 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:58:59.789420 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:58:59.799891 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:59.801698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:59.802803 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:58:59.803979 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:58:59.886697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:58:59.904197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2ec36616-e78f-4317-836d-3c7e0d172c2f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1209 microversion: 2.1 time: 0.121496 Jul 12 18:58:59.904931 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 511/955] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:59 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:00.005589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:00.013716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3fcf330f-71f0-4eab-853c-49586021451a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.264564 Jul 12 18:59:00.014261 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 445/956] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:58:59 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:00.921813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:00.922686 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:00.932447 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:00.932963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:00.933889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:00.934525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:01.012065 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:01.022343 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d4569d85-c4fc-4edd-b180-14b46d28d1e8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1271 microversion: 2.1 time: 0.104469 Jul 12 18:59:01.022991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 512/957] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:00 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:01.031930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:01.032827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:01.040333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:01.040787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:01.041564 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:01.042016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:01.125600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:01.175692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:01.185484 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-428fec77-98cf-455b-8a6c-70df81a37086 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.157924 Jul 12 18:59:01.191939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 446/958] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:01 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:02.041671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:02.042537 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:02.049266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:02.049708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:02.050468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:02.050919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:02.140323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-78fa7c62-83c1-4242-a95a-f5763365d6d5 req-073b8960-c6da-46e9-b457-797ca544b481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "591d7de5-aaac-40b3-9e22-680929e7c1be", "tag": "c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:02.154422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-78fa7c62-83c1-4242-a95a-f5763365d6d5 req-073b8960-c6da-46e9-b457-797ca544b481 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:02.155024 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-78fa7c62-83c1-4242-a95a-f5763365d6d5 req-073b8960-c6da-46e9-b457-797ca544b481 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:02.168994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-78fa7c62-83c1-4242-a95a-f5763365d6d5 req-073b8960-c6da-46e9-b457-797ca544b481 service nova] Creating event network-changed:c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c for instance 591d7de5-aaac-40b3-9e22-680929e7c1be on hv-cinder-83538 Jul 12 18:59:02.175153 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-78fa7c62-83c1-4242-a95a-f5763365d6d5 req-073b8960-c6da-46e9-b457-797ca544b481 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040228 Jul 12 18:59:02.175736 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 447/959] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:02.203674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:02.204395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:02.211644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:02.214973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:02.214973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:02.214973 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:02.407812 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:02.415117 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:02.416297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5add8aa1-b487-4611-8d30-7fd170d9600c tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.378660 Jul 12 18:59:02.416876 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 513/960] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:02 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:02.424206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f5349893-fa68-482d-9952-cdee8bec04d0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.225141 Jul 12 18:59:02.424772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 448/961] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:02 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:03.432999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:03.433671 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:03.440262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:03.440710 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:03.441211 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:03.441866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:03.442059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:03.442247 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:03.448459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:03.448904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:03.449656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:03.450088 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:03.642648 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:03.646826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:03.651011 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6af6a51d-6c97-4232-a7a2-f491d3ad1b01 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.222095 Jul 12 18:59:03.651685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 514/962] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:03 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:03.654190 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-afd2dd69-e71a-462b-99f9-0846b11f2ada tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.216736 Jul 12 18:59:03.654833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 449/963] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:03 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:04.668456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:04.669067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:04.676592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:04.677428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:04.678214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:04.678622 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:04.679080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:04.679243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:04.686010 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:04.686463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:04.687236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:04.687698 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:04.889643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:04.893335 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:04.898257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3a48a068-45ad-4233-a760-a8a84fb67916 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.233688 Jul 12 18:59:04.898823 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 515/964] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:04 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:04.901185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c81443c4-dd6b-4178-8c84-87a2f55a07ab tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.227405 Jul 12 18:59:04.901764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 450/965] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:04 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:05.914944 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:05.915589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:05.917491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:05.918110 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:05.922255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:05.922698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:05.923486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:05.923911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:05.924652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:05.925607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:05.926246 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:05.926423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:06.356851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:06.361352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:06.364784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-35f5957d-9154-4396-a955-888e6e5b9b9f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.453596 Jul 12 18:59:06.365582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 516/966] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:05 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:06.370313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-76be8728-0992-472e-a2a3-bab1bc1bc360 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.456628 Jul 12 18:59:06.371020 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 451/967] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:05 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:07.382034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:07.382611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:07.384962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:07.385804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:07.386575 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:07.387219 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:07.390792 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:07.391233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:07.392116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:07.392549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:07.393826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:07.394271 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:07.395033 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:07.395491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:07.586201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:07.589844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:07.594353 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:07.594520 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-693de972-b91b-4230-a2c8-d47c63aa117f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.216724 Jul 12 18:59:07.595202 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 517/968] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:07 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:07.602584 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a5c599b2-88b9-41f7-b724-c742ac2b91e1 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.219823 Jul 12 18:59:07.603144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 452/969] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:07 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:08.300482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:08.302655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:08.307716 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.308162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.308923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.309409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.335346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:59:08.612302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:08.612977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:08.615475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=10 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:08.622240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7f96ec7f-9347-4f8b-8878-3fa59d82ce79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 204 len: 0 microversion: 2.1 time: 0.325398 Jul 12 18:59:08.622817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.624199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 518/970] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:59:08 2022] DELETE /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:59:08.627319 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.628190 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.628657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.630377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:08.631336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:08.638235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.638896 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.639950 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.640561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.839944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:08.848619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-39d5ab68-5513-4675-bdb1-be9148a2f238 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.240133 Jul 12 18:59:08.849697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 453/971] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:08 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:08.858090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:08.858090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:08.858347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:08.863151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.863635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.864416 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.864733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5c036d09-58de-48c0-b9d7-9a0aa6783371 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.239057 Jul 12 18:59:08.864884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.865295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 519/972] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:08 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:08.877993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-7ad35c83-4356-4eed-a1f1-18123073a2fa req-f30cfd64-eec1-4f92-aa37-57b740b3c179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591d7de5-aaac-40b3-9e22-680929e7c1be", "name": "network-vif-plugged", "status": "completed", "tag": "c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:08.877993 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7ad35c83-4356-4eed-a1f1-18123073a2fa req-f30cfd64-eec1-4f92-aa37-57b740b3c179 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:08.878319 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-7ad35c83-4356-4eed-a1f1-18123073a2fa req-f30cfd64-eec1-4f92-aa37-57b740b3c179 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:08.890162 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-7ad35c83-4356-4eed-a1f1-18123073a2fa req-f30cfd64-eec1-4f92-aa37-57b740b3c179 service nova] Creating event network-vif-plugged:c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c for instance 591d7de5-aaac-40b3-9e22-680929e7c1be on hv-cinder-83538 Jul 12 18:59:08.896005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-7ad35c83-4356-4eed-a1f1-18123073a2fa req-f30cfd64-eec1-4f92-aa37-57b740b3c179 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029574 Jul 12 18:59:08.896574 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 520/973] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:09.007800 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:09.015526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-030ed5b9-22d5-47c2-b9bb-e6c51fa98994 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1579 microversion: 2.1 time: 0.164543 Jul 12 18:59:09.016090 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 454/974] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:08 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:09.873795 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:09.874477 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:09.880967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:09.881346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:09.882281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:09.882722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:09.886200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:09.886820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:09.889001 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:09.893864 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:09.894264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:09.895040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:09.895510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:10.087431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:10.095038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-16eee382-baff-4359-9486-3be6bbbbf86b tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.225876 Jul 12 18:59:10.099217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 521/975] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:09 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:10.100989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:10.101616 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:10.104721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:10.107374 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:10.107821 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:10.108578 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:10.109056 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:10.112387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-dd433f5a-275d-4400-998b-6db556923560 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.230218 Jul 12 18:59:10.114133 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 455/976] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:09 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:10.240371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:10.247838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8fca3e02-500e-4ef6-8dfa-bd869031539f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1579 microversion: 2.1 time: 0.151177 Jul 12 18:59:10.248395 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 522/977] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:10 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1579 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:10.912222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-31138454-2f42-4a8d-88f1-14df326ce1ec req-92f3cf89-3d8b-4f1c-a78f-e0a0bbcc7b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "name": "network-vif-plugged", "status": "completed", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:10.920903 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-31138454-2f42-4a8d-88f1-14df326ce1ec req-92f3cf89-3d8b-4f1c-a78f-e0a0bbcc7b1f service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:10.921353 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-31138454-2f42-4a8d-88f1-14df326ce1ec req-92f3cf89-3d8b-4f1c-a78f-e0a0bbcc7b1f service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:10.933055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-31138454-2f42-4a8d-88f1-14df326ce1ec req-92f3cf89-3d8b-4f1c-a78f-e0a0bbcc7b1f service nova] Creating event network-vif-plugged:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 18:59:10.938104 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-31138454-2f42-4a8d-88f1-14df326ce1ec req-92f3cf89-3d8b-4f1c-a78f-e0a0bbcc7b1f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029691 Jul 12 18:59:10.939216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 456/978] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:11.112459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:11.112999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:11.120324 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.120801 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.121582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.122021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.129205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:11.129948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:11.136399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.136856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.137921 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.138359 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.315268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:11.323227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-399c3f17-8a8f-4acb-bdec-db924fac46c8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.214722 Jul 12 18:59:11.323844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 523/979] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:11 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:11.337147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:11.337758 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:11.342871 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:11.343836 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.344285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.345042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:11.345475 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:11.353094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-302a3141-b132-4648-8cda-acffb70b50ba tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.227982 Jul 12 18:59:11.353853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 457/980] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:11 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:11.489137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:11.496779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-301c3e97-6e51-4bc0-96fd-f469c3ecd5e1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1579 microversion: 2.1 time: 0.163271 Jul 12 18:59:11.497352 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 524/981] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:11 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:12.288929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-4adeced2-796d-4a3e-827e-d12bd37c2d04 req-267bf193-0aa8-4130-ac4b-efa63e82e7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4323f482-9ab3-46cb-9047-09028e1c3527", "name": "network-vif-deleted", "tag": "103f2b89-5be7-4326-bc62-884c245d9f91"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:12.297556 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-4adeced2-796d-4a3e-827e-d12bd37c2d04 req-267bf193-0aa8-4130-ac4b-efa63e82e7b1 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.300254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-4adeced2-796d-4a3e-827e-d12bd37c2d04 req-267bf193-0aa8-4130-ac4b-efa63e82e7b1 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.302293 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:12.317054 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-4adeced2-796d-4a3e-827e-d12bd37c2d04 req-267bf193-0aa8-4130-ac4b-efa63e82e7b1 service nova] Creating event network-vif-deleted:103f2b89-5be7-4326-bc62-884c245d9f91 for instance 4323f482-9ab3-46cb-9047-09028e1c3527 on hv-cinder-83538 Jul 12 18:59:12.322538 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-4adeced2-796d-4a3e-827e-d12bd37c2d04 req-267bf193-0aa8-4130-ac4b-efa63e82e7b1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105897 Jul 12 18:59:12.323143 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 458/982] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:12.339613 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:12.340279 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:12.347621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.349120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.350095 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.350680 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.384185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:12.387389 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:12.399716 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.400449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.401412 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.406101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.607185 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:12.612314 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:12.615341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8d8bdacf-7bce-418c-9c22-5a45bf90a93f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1313 microversion: 2.1 time: 0.279529 Jul 12 18:59:12.616118 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 525/983] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:12 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:12.620609 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:12.621041 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-90af10dd-5e0e-49d0-89ab-a7c840205364 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.244451 Jul 12 18:59:12.621439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:12.627584 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.628036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.629366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:12.629958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:12.631605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 459/984] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:12 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:12.693498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:12.700884 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f1ed0c59-af7c-4afd-955e-5997c61c97c1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1225 microversion: 2.1 time: 0.083977 Jul 12 18:59:12.701448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 526/985] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:12 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:13.632242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:13.633121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:13.637983 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:13.638592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:13.640106 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.640563 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.641366 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.641813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.645271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.645723 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.646485 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.646921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.841931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:13.850183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6aa8717a-f2c6-40d2-92bc-108f41c490dc tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1496 microversion: 2.1 time: 0.222301 Jul 12 18:59:13.851526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 460/986] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:13 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1496 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:13.856334 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:13.856645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:13.856936 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:13.862980 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.863450 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.864718 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.864916 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.865251 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1301cb97-d7a5-47dd-a28f-8625e1fdbc0d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1258 microversion: 2.1 time: 0.231143 Jul 12 18:59:13.865894 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 527/987] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:13 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1258 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:13.896824 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:13.897118 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:13.897561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lazy-loading 'fault' on Instance uuid 4323f482-9ab3-46cb-9047-09028e1c3527 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:59:13.939823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:13.947328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-236545a7-9fac-4ad2-8bb5-311f1b82e004 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 200 len: 1230 microversion: 2.1 time: 0.094837 Jul 12 18:59:13.947906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 461/988] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:13 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:14.702103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:14.702718 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:14.709923 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:14.710373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:14.711262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:14.711725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:14.738486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 18:59:14.882909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:14.883547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:14.890626 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:14.891067 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:14.891864 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:14.892333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.031373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:15.039957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ab25c84d-aaca-4ae2-ba70-4e7fcefef707 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1441 microversion: 2.1 time: 0.161932 Jul 12 18:59:15.040644 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 462/989] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:14 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1441 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:15.045472 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:15.046088 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:15.053773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.054146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.054924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.055392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.069544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] HTTP exception thrown: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Request method failure captured: Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 HTTP/1.1 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcOzd2wPHK6Nq4QFFBIslLU18ZYkdz8YY_tLPrVyuWcP-ufNFzx05vUOENVikowZKNLWyfPAxa7McntpnstfDPSvH1bj5Yqub7qRL132BMcebFg8gu78HIJ01ZKsuqoS4Cws5BZlJl0xrRv04o2ZkY_RDz3Pv4wKC1vO2m7_TY317kI Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 18:59:15.071209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f20a43af9cc4c68904ba717560e3789", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestVolumeBootPattern-652715060 Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestVolumeBootPattern-652715060-project Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 584b15b723a94f8bb380b76a2db97fc8 Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestVolumeBootPattern-652715060-project Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 18:59:15.072995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '4323f482-9ab3-46cb-9047-09028e1c3527'} Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:59:15.074097 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 18:59:15.075683 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 18:59:15.077139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Returning 404 to user: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:59:15.077139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-10e3709a-243a-4e8c-91ef-e801691fb519 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 404 len: 111 microversion: 2.1 time: 0.031169 Jul 12 18:59:15.077139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 463/990] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:15 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:59:15.077659 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:15.078266 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:15.085829 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e5c93664-0582-4e8b-bd1d-040b301a7592 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "DELETE /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 204 len: 0 microversion: 2.1 time: 0.387190 Jul 12 18:59:15.086032 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.086587 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 528/991] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 18:59:14 2022] DELETE /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 18:59:15.086723 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.088137 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.088700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.094697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:15.095432 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:15.101525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.101991 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.102733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.103164 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.297428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:15.299930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:15.306018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-75847d6a-0170-4509-915b-1a773b066cb8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1441 microversion: 2.1 time: 0.231836 Jul 12 18:59:15.306627 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 464/992] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:15 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1441 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:15.311515 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dd221c4b-ca94-4c39-8c0a-14b679e44f87 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1502 microversion: 2.1 time: 0.220847 Jul 12 18:59:15.312086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 529/993] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:15 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:15.319633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-858900518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163641014", "security_groups": [{"name": "tempest-secgroup-smoke-1862185695"}], "block_device_mapping_v2": [{"uuid": "9c32c773-4bbd-49d8-ae2b-71d4513b8740", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9d6ae291-a6e1-46b3-8050-3516d4ef624f"}]}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:15.429855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] validate_networks() for [('9d6ae291-a6e1-46b3-8050-3516d4ef624f', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 18:59:15.807107 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 18:59:15.807552 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 18:59:15.808018 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 18:59:15.808452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 18:59:15.808856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 18:59:15.820948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.821392 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.822707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:15.823141 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:15.840694 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 18:59:15.844793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for user 584b15b723a94f8bb380b76a2db97fc8 and project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 18:59:15.908441 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 18:59:15.910524 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c32c773-4bbd-49d8-ae2b-71d4513b8740',volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 18:59:16.246966 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-439850fa-52d3-49fb-9f95-cc31148b32eb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.936652 Jul 12 18:59:16.247832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 465/994] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 18:59:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 18:59:16.258215 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-955d77b3-8904-4f02-88a8-dbdff2ec1cbb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:16.258818 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-955d77b3-8904-4f02-88a8-dbdff2ec1cbb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:16.314484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-955d77b3-8904-4f02-88a8-dbdff2ec1cbb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:16.324207 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-955d77b3-8904-4f02-88a8-dbdff2ec1cbb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1094 microversion: 2.1 time: 0.070106 Jul 12 18:59:16.328052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 530/995] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:16 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:16.337186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:16.339236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:16.352341 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:16.352803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:16.353600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:16.354042 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:16.503895 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:16.513333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-6c3ea61c-57b5-4ce6-b41a-5f5db76f6ff8 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1502 microversion: 2.1 time: 0.187509 Jul 12 18:59:16.514027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 466/996] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:16 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:17.345504 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:17.346100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:17.354335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:17.354916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:17.355793 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:17.356401 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:17.424284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:17.432426 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5bbef107-1b0c-4b4f-8f1e-55c04f241853 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1144 microversion: 2.1 time: 0.090864 Jul 12 18:59:17.434746 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 531/997] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:17 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:17.531011 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:17.532265 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:17.540345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:17.540799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:17.541581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:17.542022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:17.676420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:17.685434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7e59b8da-260e-4f0a-ab0d-be373c2f4add tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1502 microversion: 2.1 time: 0.158259 Jul 12 18:59:17.686121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 467/998] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:17 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:17.913103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-ae721c04-4618-4899-afac-c554e047a691 req-43425255-5bab-46c6-9c1e-58ca6bfd844b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "591d7de5-aaac-40b3-9e22-680929e7c1be", "name": "network-vif-deleted", "tag": "c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:17.921441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ae721c04-4618-4899-afac-c554e047a691 req-43425255-5bab-46c6-9c1e-58ca6bfd844b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:17.921980 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-ae721c04-4618-4899-afac-c554e047a691 req-43425255-5bab-46c6-9c1e-58ca6bfd844b service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:17.934788 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-ae721c04-4618-4899-afac-c554e047a691 req-43425255-5bab-46c6-9c1e-58ca6bfd844b service nova] Creating event network-vif-deleted:c7b3cb91-1a9a-4c0f-8fcc-18010a0e473c for instance 591d7de5-aaac-40b3-9e22-680929e7c1be on hv-cinder-83538 Jul 12 18:59:17.940169 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-ae721c04-4618-4899-afac-c554e047a691 req-43425255-5bab-46c6-9c1e-58ca6bfd844b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031927 Jul 12 18:59:17.943286 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 532/999] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:18.459658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:18.459658 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:18.462076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:18.462799 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:18.463947 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:18.464489 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:18.533813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:18.542453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bb6126db-da8f-4279-85d3-567f928af703 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1210 microversion: 2.1 time: 0.092923 Jul 12 18:59:18.543027 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 468/1000] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:18 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:18.705285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:18.706534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:18.726730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:18.726730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:18.726730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:18.726730 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:18.764969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:18.780951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:18.781397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:18.786563 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lazy-loading 'fault' on Instance uuid 591d7de5-aaac-40b3-9e22-680929e7c1be {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 18:59:18.838376 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26100386121440288ffafe02ead22bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb0905c39dff4c479c49929445fec3e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:18.846107 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cbe37def-dbe4-44f7-8f47-b95e9971b54f tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 200 len: 1303 microversion: 2.1 time: 0.145569 Jul 12 18:59:18.846688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 533/1001] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:18 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:19.564667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:19.565342 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:19.572289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:19.572907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:19.573747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:19.574365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:19.711595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:19.719833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-887729ef-d870-4735-839b-0bce4403c13d tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1278 microversion: 2.1 time: 0.159138 Jul 12 18:59:19.720525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 469/1002] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:19 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:19.864178 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:19.864834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] [instance: 591d7de5-aaac-40b3-9e22-680929e7c1be] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:19.871837 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:19.872281 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:19.873057 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:19.873540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:19.888136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] HTTP exception thrown: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Request method failure captured: Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be HTTP/1.1 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRVXkuEEEXWv2fnbvezYa3z_fGRcKKB7Uv8t29xFaPgGktcZENetnmkSHaBQHdf-pGHY391S2Hcg9StsoZAYiI0Wod1JtDtBBzSeOZggkn9pRl-MQeGZpH4F6uTYwdNx-8pqvJHwPOL_hEyqVQzIDSjFyNjTyC2i-fwLD701Y2_H78 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: bb0905c39dff4c479c49929445fec3e3 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-VolumesActionsTest-1264813250 Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 18:59:19.889798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bb0905c39dff4c479c49929445fec3e3", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bb0905c39dff4c479c49929445fec3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-VolumesActionsTest-1264813250 Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: bb0905c39dff4c479c49929445fec3e3 Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-VolumesActionsTest-1264813250 Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-VolumesActionsTest-1264813250-project Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 26100386121440288ffafe02ead22bd0 Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-VolumesActionsTest-1264813250-project Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. Jul 12 18:59:19.891172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '591d7de5-aaac-40b3-9e22-680929e7c1be'} Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 18:59:19.892042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. Jul 12 18:59:19.894049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 18:59:19.895201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] Returning 404 to user: Instance 591d7de5-aaac-40b3-9e22-680929e7c1be could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 18:59:19.895201 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c348e522-6a9a-4846-b5a3-169651491203 tempest-VolumesActionsTest-1264813250 tempest-VolumesActionsTest-1264813250-project] 10.222.0.59 "GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be" status: 404 len: 111 microversion: 2.1 time: 0.031271 Jul 12 18:59:19.900119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 534/1003] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:19 2022] GET /compute/v2.1/servers/591d7de5-aaac-40b3-9e22-680929e7c1be => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 18:59:19.959997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-dd19cc28-8d73-4f1a-8835-7e34ed660ac3 req-dd4ef538-5350-4862-a581-cff841e49d22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:19.967948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-dd19cc28-8d73-4f1a-8835-7e34ed660ac3 req-dd4ef538-5350-4862-a581-cff841e49d22 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:19.968383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-dd19cc28-8d73-4f1a-8835-7e34ed660ac3 req-dd4ef538-5350-4862-a581-cff841e49d22 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:19.979825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-dd19cc28-8d73-4f1a-8835-7e34ed660ac3 req-dd4ef538-5350-4862-a581-cff841e49d22 service nova] Creating event network-changed:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 18:59:19.984674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-dd19cc28-8d73-4f1a-8835-7e34ed660ac3 req-dd4ef538-5350-4862-a581-cff841e49d22 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028964 Jul 12 18:59:19.985345 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 470/1004] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:20.737698 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:20.738303 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:20.744860 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:20.745434 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:20.750317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:20.750317 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:20.881015 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:20.889070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-05c50815-0fa2-4cf1-b67b-fcde5558053e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.155669 Jul 12 18:59:20.889700 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 535/1005] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:20 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:21.907068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:21.907787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:21.914030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:21.914473 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:21.915226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:21.915692 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:22.000211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-8800061c-ea48-4ef9-a9f2-92b02672e82c req-1e04db31-ca9f-4bb2-97d0-e339309ef4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269b4dad-a4bb-42b2-a2db-d769ac237200", "tag": "80d57f5e-8737-4f65-8d46-d300fa8ecda2"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:22.009241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-8800061c-ea48-4ef9-a9f2-92b02672e82c req-1e04db31-ca9f-4bb2-97d0-e339309ef4cf service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:22.009672 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-8800061c-ea48-4ef9-a9f2-92b02672e82c req-1e04db31-ca9f-4bb2-97d0-e339309ef4cf service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:22.020820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-8800061c-ea48-4ef9-a9f2-92b02672e82c req-1e04db31-ca9f-4bb2-97d0-e339309ef4cf service nova] Creating event network-changed:80d57f5e-8737-4f65-8d46-d300fa8ecda2 for instance 269b4dad-a4bb-42b2-a2db-d769ac237200 on hv-cinder-83538 Jul 12 18:59:22.025548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-8800061c-ea48-4ef9-a9f2-92b02672e82c req-1e04db31-ca9f-4bb2-97d0-e339309ef4cf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029063 Jul 12 18:59:22.026139 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 536/1006] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 18:59:22.049581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:22.058025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-597fe9bb-0490-415d-a00a-c167e6354755 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.155699 Jul 12 18:59:22.058654 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 471/1007] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:21 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:23.075708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:23.076407 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:23.082721 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:23.083869 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:23.084649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:23.085088 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:23.215130 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:23.222911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8ec2e6b4-737a-4b91-9a27-a9087f3beab8 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.152035 Jul 12 18:59:23.224064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 537/1008] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:23 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:24.240756 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:24.241372 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:24.247962 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:24.248411 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:24.249179 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:24.249618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:24.383508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:24.391198 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1f9571d5-2da9-477f-9f8d-b259ade2b959 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.154620 Jul 12 18:59:24.391789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 472/1009] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:24 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:25.408316 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:25.408914 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:25.416136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:25.416581 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:25.417338 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:25.417767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:25.549637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:25.557936 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d9e166e0-8a3e-45ab-b1c4-080e406d18fa tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.153489 Jul 12 18:59:25.558523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 538/1010] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:25 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:26.574822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:26.575516 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:26.580076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:26.580876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:26.585169 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:26.585619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:26.586387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:26.586822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:26.735581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:26.743208 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f67d4eac-f200-49ad-8b63-cf6d4d3afdf1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.172338 Jul 12 18:59:26.743814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 473/1011] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:26 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:27.760759 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:27.761608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:27.764021 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:27.765217 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:27.770347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:27.776276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:27.776276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:27.776276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:27.945183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:27.952865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5853bf5f-7aea-4451-8642-196576c0cc3e tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.196190 Jul 12 18:59:27.953519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 539/1012] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:27 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:28.971673 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:28.973336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:28.981857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:28.982302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:28.983069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:28.983559 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:29.150073 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:29.159547 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cd6562ef-2fc2-4d5d-a10d-89b1a0226dc4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.193100 Jul 12 18:59:29.160109 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 474/1013] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:28 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 18:59:30.176819 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:30.177345 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:30.184638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:30.185093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:30.185870 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:30.186305 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:30.334373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:30.342850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f00360e4-7caa-4349-9309-94e77cc4a9e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.169868 Jul 12 18:59:30.344119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 540/1014] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:30 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:31.361378 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:31.362698 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:31.373038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:31.373695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:31.374956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:31.375897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:31.551212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:31.561974 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-09a0fd42-2030-4fa5-ac00-9546ab7ee006 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.205107 Jul 12 18:59:31.563025 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 475/1015] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:31 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:32.580097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:32.581445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:32.588000 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:32.588448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:32.589285 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:32.589651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:32.734076 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:32.742085 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c80c2eab-4734-4f14-b56f-9b035ac31fd6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.165890 Jul 12 18:59:32.742653 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 541/1016] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:32 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:33.760675 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:33.762061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:33.771846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:33.772458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:33.773499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:33.773943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:33.941798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:33.951154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-469d8469-ea8e-49e1-95e7-c936d13697bc tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.195513 Jul 12 18:59:33.962210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 476/1017] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:33 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:34.792843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-8210b184-6230-419f-8991-d3b69f1ae428 req-17338121-ca0b-45d0-9a00-f35768d7c9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269b4dad-a4bb-42b2-a2db-d769ac237200", "name": "network-vif-plugged", "status": "completed", "tag": "80d57f5e-8737-4f65-8d46-d300fa8ecda2"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:34.805589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-8210b184-6230-419f-8991-d3b69f1ae428 req-17338121-ca0b-45d0-9a00-f35768d7c9d7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:34.806160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-8210b184-6230-419f-8991-d3b69f1ae428 req-17338121-ca0b-45d0-9a00-f35768d7c9d7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:34.826545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-8210b184-6230-419f-8991-d3b69f1ae428 req-17338121-ca0b-45d0-9a00-f35768d7c9d7 service nova] Creating event network-vif-plugged:80d57f5e-8737-4f65-8d46-d300fa8ecda2 for instance 269b4dad-a4bb-42b2-a2db-d769ac237200 on hv-cinder-83538 Jul 12 18:59:34.834377 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-8210b184-6230-419f-8991-d3b69f1ae428 req-17338121-ca0b-45d0-9a00-f35768d7c9d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046415 Jul 12 18:59:34.835845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 542/1018] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 18:59:34.970731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:34.971294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:34.978147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:34.978901 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:34.979906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:34.980585 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:35.002817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=100 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:35.140983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:35.149199 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cede0541-5810-4ce5-a943-68cbbf7f1509 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.183015 Jul 12 18:59:35.149970 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 477/1019] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:34 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:36.168510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:36.169598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:36.180679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:36.181590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:36.182750 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:36.184022 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:36.334854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:36.343783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-085a9d2f-0775-4e30-8f6c-41589ca0220a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1266 microversion: 2.1 time: 0.181671 Jul 12 18:59:36.349585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 543/1020] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:36 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:37.366198 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:37.367740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:37.375327 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:37.375945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:37.377028 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:37.377614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:37.534121 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:37.543649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4fa8388a-b1a3-4e7a-96ef-50f9bc3491a1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1454 microversion: 2.1 time: 0.181725 Jul 12 18:59:37.544897 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 478/1021] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:37 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:37.562828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 18:59:37.563630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 18:59:37.570303 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:37.570981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:37.572030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:37.572666 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:37.730392 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 18:59:37.740754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-3d96f0f8-f80e-4a52-b214-af68d599490f tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1454 microversion: 2.1 time: 0.181557 Jul 12 18:59:37.742321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 544/1022] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 18:59:37 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 18:59:40.189466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-16a3151f-fcd8-4de5-86ea-880c8efe89e7 req-f825ffd1-ca24-4582-b368-7a5844b51c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269b4dad-a4bb-42b2-a2db-d769ac237200", "tag": "80d57f5e-8737-4f65-8d46-d300fa8ecda2"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 18:59:40.199271 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:59:40.201599 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-16a3151f-fcd8-4de5-86ea-880c8efe89e7 req-f825ffd1-ca24-4582-b368-7a5844b51c32 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 18:59:40.202149 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-16a3151f-fcd8-4de5-86ea-880c8efe89e7 req-f825ffd1-ca24-4582-b368-7a5844b51c32 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 18:59:40.220094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-16a3151f-fcd8-4de5-86ea-880c8efe89e7 req-f825ffd1-ca24-4582-b368-7a5844b51c32 service nova] Creating event network-changed:80d57f5e-8737-4f65-8d46-d300fa8ecda2 for instance 269b4dad-a4bb-42b2-a2db-d769ac237200 on hv-cinder-83538 Jul 12 18:59:40.227444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-16a3151f-fcd8-4de5-86ea-880c8efe89e7 req-f825ffd1-ca24-4582-b368-7a5844b51c32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041954 Jul 12 18:59:40.233841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 479/1023] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 18:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 19:00:39.246054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=11 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:39.250922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=58 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:39.251096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:00:39.251621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:00:39.257448 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:39.257897 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:39.258661 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:39.259098 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:39.282782 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-957146bd-77b8-4ff0-81b2-48897857b78e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/ips" status: 200 len: 148 microversion: 2.1 time: 0.038932 Jul 12 19:00:39.283431 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 545/1024] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 19:00:39 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:00:45.169474 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=12 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:45.173905 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3acaea36-fca2-4082-a934-09ad10b6735d"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:00:45.175115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:00:45.181762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:45.182209 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:45.182959 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:45.184076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:45.959420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b932cb8e-5d75-4de4-bbac-4f64068508ed tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.783858 Jul 12 19:00:45.959420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 480/1025] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 19:00:45 2022] POST /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:00:54.509261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-872d8799-8c24-42a2-b439-c5e78fe878cf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: .version_select at 0x7f0178690430>, body: {"keypair": {"name": "tempest-keypair-90443879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEieX/2RzhOdnKyu8mUbBaOC9ecbvSnJ7dD5c4qrZ++leT5kGMHfAgDLSUkYyrcP9uox+if2cE0+x7O5Mye7DMJZIVCiurRadVrUjUVQjaCAy6RCxMXsm1Vn0Yp7EJlGmA=="}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:00:54.524874 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-872d8799-8c24-42a2-b439-c5e78fe878cf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:00:54.529086 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-872d8799-8c24-42a2-b439-c5e78fe878cf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:00:54.616459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-872d8799-8c24-42a2-b439-c5e78fe878cf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.111597 Jul 12 19:00:54.617075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 546/1026] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 19:00:54 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:00:56.823330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:56.824266 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:00:56.829383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-928452590", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae8b0f6-4fda-4639-886a-ca703e1b912a"}], "security_groups": [{"name": "tempest-securitygroup--1885738992"}], "key_name": "tempest-keypair-90443879", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:00:56.935561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] validate_networks() for [('cae8b0f6-4fda-4639-886a-ca703e1b912a', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 19:00:57.424639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 19:00:57.425058 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 19:00:57.425525 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 19:00:57.425926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 19:00:57.426333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 19:00:57.435732 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:57.436174 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:57.436964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:57.437396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:57.454586 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:00:57.458526 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:00:57.470994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 19:00:57.473428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 19:00:57.602581 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ac54202b-68e7-4a29-ace2-9b92380e4f9a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.780680 Jul 12 19:00:57.603165 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 481/1027] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 19:00:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 19:00:57.613850 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-be777152-8900-41f9-933d-9a61818b6c5e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:00:57.614497 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-be777152-8900-41f9-933d-9a61818b6c5e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:00:57.669660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-be777152-8900-41f9-933d-9a61818b6c5e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:00:57.677334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-be777152-8900-41f9-933d-9a61818b6c5e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1239 microversion: 2.1 time: 0.068079 Jul 12 19:00:57.677893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 547/1028] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:00:57 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:00:58.696068 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:00:58.696679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:00:58.704535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:58.704997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:58.705797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:58.706250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:58.773540 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:00:58.781056 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f20ecda3-fe20-4582-9907-a8e4df3045fa tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1243 microversion: 2.1 time: 0.089613 Jul 12 19:00:58.781603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 482/1029] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:00:58 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:00:59.798105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:00:59.798846 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:00:59.805696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:59.806108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:59.806963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:00:59.807493 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:00:59.876254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:00:59.889978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-119fe6fe-cfe8-4672-9d34-1ddf6a94a2bb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1309 microversion: 2.1 time: 0.095683 Jul 12 19:00:59.890663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 548/1030] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:00:59 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:00.908944 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:00.909602 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:00.916535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:00.916987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:00.918685 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:00.919772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:01.064006 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:01.071826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4a62e6fc-0934-4e78-9b1b-e288347432f6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.168158 Jul 12 19:01:01.072690 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 483/1031] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:00 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:01.185813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-3ad226b1-3ef9-46a3-9605-87f03f977159 req-1949213f-25b0-4038-bd37-ce7998d4a0bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7693fc25-26b5-4079-8624-85c79bf6ee39", "tag": "1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:01:01.196051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-3ad226b1-3ef9-46a3-9605-87f03f977159 req-1949213f-25b0-4038-bd37-ce7998d4a0bc service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:01.196791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-3ad226b1-3ef9-46a3-9605-87f03f977159 req-1949213f-25b0-4038-bd37-ce7998d4a0bc service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:01.214598 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-3ad226b1-3ef9-46a3-9605-87f03f977159 req-1949213f-25b0-4038-bd37-ce7998d4a0bc service nova] Creating event network-changed:1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9 for instance 7693fc25-26b5-4079-8624-85c79bf6ee39 on hv-cinder-83538 Jul 12 19:01:01.220807 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-3ad226b1-3ef9-46a3-9605-87f03f977159 req-1949213f-25b0-4038-bd37-ce7998d4a0bc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039296 Jul 12 19:01:01.225106 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 549/1032] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:01:02.091529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:02.092131 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:02.098769 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:02.099222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:02.100070 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:02.100508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:02.230639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:02.238595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d77bfd03-146c-4eed-b302-4fdac1f57851 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.151365 Jul 12 19:01:02.239152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 484/1033] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:02 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:03.258145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:03.366663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:03.366663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:03.366663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:03.366663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:03.367880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:03.407662 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:03.415233 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e5ceee11-d19f-4f6f-b437-0188a01a2e48 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.162455 Jul 12 19:01:03.415822 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 550/1034] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:03 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:04.432111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:04.432771 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:04.439624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:04.440072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:04.440862 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:04.441316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:04.569514 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:04.577678 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bb2309e2-f0bc-4c27-bedb-8ce258085bdf tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.149464 Jul 12 19:01:04.578236 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 485/1035] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:04 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:05.595043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:05.595677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:05.603015 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:05.603505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:05.604266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:05.604695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:05.737971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:05.745600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-24057c68-48a2-4523-8f87-b33c6b742c12 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.155560 Jul 12 19:01:05.746166 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 551/1036] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:05 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:06.761922 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:06.762535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:06.769211 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:06.769655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:06.770402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:06.770830 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:06.897328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:06.905045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-068ff4df-106b-4665-9bb6-ddf8c3d5750e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.146968 Jul 12 19:01:06.905542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 486/1037] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:06 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:07.675842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:01:07.749534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-86dd976f-0d4d-4d0e-b5fe-f9d71ccf2c63 req-30c6b6e4-da0a-4ec3-9ec3-fecce03fd15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7693fc25-26b5-4079-8624-85c79bf6ee39", "name": "network-vif-plugged", "status": "completed", "tag": "1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:01:07.757694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-86dd976f-0d4d-4d0e-b5fe-f9d71ccf2c63 req-30c6b6e4-da0a-4ec3-9ec3-fecce03fd15a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:07.764311 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-86dd976f-0d4d-4d0e-b5fe-f9d71ccf2c63 req-30c6b6e4-da0a-4ec3-9ec3-fecce03fd15a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:07.769754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-86dd976f-0d4d-4d0e-b5fe-f9d71ccf2c63 req-30c6b6e4-da0a-4ec3-9ec3-fecce03fd15a service nova] Creating event network-vif-plugged:1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9 for instance 7693fc25-26b5-4079-8624-85c79bf6ee39 on hv-cinder-83538 Jul 12 19:01:07.774702 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-86dd976f-0d4d-4d0e-b5fe-f9d71ccf2c63 req-30c6b6e4-da0a-4ec3-9ec3-fecce03fd15a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159540 Jul 12 19:01:07.775283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 552/1038] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:01:07.922059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:07.922670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:07.924594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:01:07.925250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:01:07.930565 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:07.931012 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:07.931798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:07.932231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:08.070069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:08.078229 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a2e2dc64-9692-41e3-88b9-6b2030cbef60 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.160267 Jul 12 19:01:08.078802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 487/1039] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:07 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:09.096359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:09.097050 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:09.103297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:09.103768 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:09.104511 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:09.104966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:09.237147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:09.244442 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-af2a02bf-17b3-4518-9ad5-7010bf2a3f5d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.153092 Jul 12 19:01:09.244998 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 553/1040] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:09 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:10.263164 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:10.264206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:10.271387 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:10.271840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:10.272614 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:10.273052 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:10.406606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:10.414010 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ac65aa10-68f5-41bb-8a3f-fa16274b2948 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1365 microversion: 2.1 time: 0.155817 Jul 12 19:01:10.415624 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 488/1041] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:10 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:11.431986 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:11.432629 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:11.439159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:11.439635 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:11.440398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:11.440834 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:11.568714 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:01:11.577183 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e5c5811e-7bd0-46e9-9d39-637d27b6207e tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1555 microversion: 2.1 time: 0.149080 Jul 12 19:01:11.577813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 554/1042] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:01:11 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:01:11.593731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:01:11.594301 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:01:11.600700 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:11.601139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:11.602001 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:11.602305 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:11.680156 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ade5f860-3ae7-4d11-b3e2-b9adfe3e3a0f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090282 Jul 12 19:01:11.680787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 489/1043] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 19:01:11 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:01:12.987211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-f4618e74-166e-4c5f-a670-be259b578bce req-9f9eb0c9-617d-42be-a614-246e517d0000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7693fc25-26b5-4079-8624-85c79bf6ee39", "tag": "1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:01:12.995636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-f4618e74-166e-4c5f-a670-be259b578bce req-9f9eb0c9-617d-42be-a614-246e517d0000 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:01:12.996262 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-f4618e74-166e-4c5f-a670-be259b578bce req-9f9eb0c9-617d-42be-a614-246e517d0000 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:01:13.007649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-f4618e74-166e-4c5f-a670-be259b578bce req-9f9eb0c9-617d-42be-a614-246e517d0000 service nova] Creating event network-changed:1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9 for instance 7693fc25-26b5-4079-8624-85c79bf6ee39 on hv-cinder-83538 Jul 12 19:01:13.014065 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-f4618e74-166e-4c5f-a670-be259b578bce req-9f9eb0c9-617d-42be-a614-246e517d0000 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098096 Jul 12 19:01:13.015062 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 555/1044] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:01:24.985130 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:01:24.985599 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:01:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:01:55.547489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:01:55.548100 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:01:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:02:06.702677 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:06.703459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=48 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:06.707595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:06.708145 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:06.713931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:06.717157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:06.717157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:06.717157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:06.739731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lazy-loading 'flavor' on Instance uuid a2ef7557-2e4e-4091-a6ab-e0abb25650c8 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:02:06.986115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d234bd09-ec52-41f8-b521-5dba94dcd7ce tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "POST /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8/action" status: 202 len: 0 microversion: 2.1 time: 0.283981 Jul 12 19:02:06.986697 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 490/1045] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 19:02:06 2022] POST /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:02:06.995613 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:06.996353 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:07.000341 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:07.001735 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=40 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:07.005779 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:07.006228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:07.007037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:07.007522 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:07.140390 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:07.150105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-03495c70-11bc-4700-a7d4-bd962764caa8 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.158472 Jul 12 19:02:07.150663 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 556/1046] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:06 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:08.170994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:08.171713 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:08.178394 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:08.178780 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:08.179555 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:08.179993 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:08.314195 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:08.321719 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a83c1c9c-b2d9-48cf-8449-7cef3b7cddda tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.155414 Jul 12 19:02:08.322277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 491/1047] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:08 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:09.339206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:09.339853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:09.346398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:09.346839 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:09.347638 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:09.348068 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:09.551644 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:09.559199 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-13bded3d-154d-45d1-b14d-b62ef8872f63 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.223848 Jul 12 19:02:09.559799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 557/1048] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:09 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:10.209661 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008325497", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163641014", "security_groups": [{"name": "tempest-secgroup-smoke-1862185695"}], "block_device_mapping_v2": [{"uuid": "9761f481-9f51-4cf2-acc8-d5f2beebb61f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9d6ae291-a6e1-46b3-8050-3516d4ef624f"}]}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:10.322574 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] validate_networks() for [('9d6ae291-a6e1-46b3-8050-3516d4ef624f', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 19:02:10.577078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:10.577712 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:10.584705 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:10.585156 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:10.585935 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:10.586370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:10.751499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 19:02:10.751894 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 19:02:10.752434 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 19:02:10.752842 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 19:02:10.753273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 19:02:10.762793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:10.763231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:10.764046 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:10.764960 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:10.783766 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:02:10.785160 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:10.787933 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Getting quotas for user 584b15b723a94f8bb380b76a2db97fc8 and project 0f20a43af9cc4c68904ba717560e3789. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:02:10.792785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-252d8360-cb7e-480b-9aa2-a2d58a485f7c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.219614 Jul 12 19:02:10.793350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 558/1049] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:10 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:02:10.848935 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 19:02:10.850999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9761f481-9f51-4cf2-acc8-d5f2beebb61f',volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 19:02:11.275485 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-66b13561-dfea-4dc8-95b3-5aefd3e1cbce tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070297 Jul 12 19:02:11.280948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 492/1050] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 19:02:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 19:02:11.286284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4479d6a0-1da6-4e5a-93f0-4dd626d8aeea tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:11.286905 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4479d6a0-1da6-4e5a-93f0-4dd626d8aeea tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:11.343967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4479d6a0-1da6-4e5a-93f0-4dd626d8aeea tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:11.350643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4479d6a0-1da6-4e5a-93f0-4dd626d8aeea tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1095 microversion: 2.1 time: 0.068387 Jul 12 19:02:11.351200 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 559/1051] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:11 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:11.810146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:11.810816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:11.817853 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:11.818363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:11.822333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:11.822333 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:11.953268 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:11.960852 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-5ed4be12-09e7-4f0d-9570-fbf003820569 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.154620 Jul 12 19:02:11.961471 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 493/1052] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:11 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:12.367862 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:12.368443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:12.382987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:12.382987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:12.382987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:12.382987 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:12.438339 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:12.446335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-99db31c3-3bcf-4bad-837e-08c21b75e61a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1145 microversion: 2.1 time: 0.082400 Jul 12 19:02:12.446905 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 560/1053] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:12 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:12.977841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:12.978446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:12.984981 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:12.985569 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:12.986328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:12.986757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:13.119726 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:13.129449 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-4cdc1051-59a1-4782-8874-a65bc0c833a7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.155456 Jul 12 19:02:13.130021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 494/1054] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:12 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:13.462582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:13.463186 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:13.469510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:13.469947 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:13.470694 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:13.471121 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:13.541379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:13.544658 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c732b797-b88b-4e4c-98f9-851f7c392f05 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1211 microversion: 2.1 time: 0.085864 Jul 12 19:02:13.545677 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 561/1055] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:13 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:14.148200 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:14.148821 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:14.155749 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:14.156232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:14.157669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:14.158101 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:14.367708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:14.376139 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-72d4a659-78de-4330-8701-7d06e059b53d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.233073 Jul 12 19:02:14.376709 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 495/1056] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:14 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:14.562070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:14.562681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:14.570010 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:14.570409 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:14.571175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:14.571814 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:14.701611 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:14.710151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0585b072-e9fe-4d26-948c-a348b0b31cbf tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1279 microversion: 2.1 time: 0.151918 Jul 12 19:02:14.719402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 562/1057] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:14 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:15.044765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-c7afc84a-dc1a-492f-a8d4-dc7c7897869e req-c2cd05eb-aadf-40ba-9447-215a5ee52bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13841344-7c55-4c40-9741-e41564d5e784", "tag": "04cbb2b7-c19f-4a61-bd78-ffa21c3580cc"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:15.055498 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c7afc84a-dc1a-492f-a8d4-dc7c7897869e req-c2cd05eb-aadf-40ba-9447-215a5ee52bb7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:15.060499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c7afc84a-dc1a-492f-a8d4-dc7c7897869e req-c2cd05eb-aadf-40ba-9447-215a5ee52bb7 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:15.069076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-c7afc84a-dc1a-492f-a8d4-dc7c7897869e req-c2cd05eb-aadf-40ba-9447-215a5ee52bb7 service nova] Creating event network-changed:04cbb2b7-c19f-4a61-bd78-ffa21c3580cc for instance 13841344-7c55-4c40-9741-e41564d5e784 on hv-cinder-83538 Jul 12 19:02:15.074196 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-c7afc84a-dc1a-492f-a8d4-dc7c7897869e req-c2cd05eb-aadf-40ba-9447-215a5ee52bb7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Jul 12 19:02:15.075160 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 496/1058] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:15.393314 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:15.393951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:15.400367 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:15.400826 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:15.401608 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:15.402042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:15.591613 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:15.599917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-95ef4eec-1386-4b11-9554-1dbc266e1418 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.210846 Jul 12 19:02:15.600496 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 563/1059] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:15 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:15.727480 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:15.728191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:15.734452 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:15.735510 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:15.736330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:15.736776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:15.951066 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:15.958822 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c0ed7900-4d79-41dd-ae58-e4de444695c2 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.236131 Jul 12 19:02:15.959402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 497/1060] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:15 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:16.616985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:16.617602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:16.624240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:16.624755 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:16.625534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:16.625962 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:16.756784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:16.764505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-134c7d80-95ae-415b-90e8-5080899b798b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.151250 Jul 12 19:02:16.765068 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 564/1061] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:16 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:16.975934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:16.976539 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:16.982945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:16.983421 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:16.984206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:16.984636 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:17.120807 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:17.128536 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-87b3b836-0bd9-4ea3-b411-4245be7ed0b6 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.156470 Jul 12 19:02:17.129096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 498/1062] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:16 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:17.782335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:17.782940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:17.789502 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:17.789946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:17.790722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:17.791149 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:17.925370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:17.932752 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-315e1151-5820-440f-a02a-a2c3279078cb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.154507 Jul 12 19:02:17.933388 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 565/1063] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:17 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:18.145422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:18.146037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:18.152557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:18.153005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:18.153773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:18.154214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:18.289396 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:18.297077 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-15fccc70-ce6c-4533-b6a6-e65a0c1b653a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.156109 Jul 12 19:02:18.297659 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 499/1064] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:18 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:18.949828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:18.950436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:18.956872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:18.957321 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:18.958078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:18.958510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:19.085099 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:19.092413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-497caba2-6cab-42a6-8a03-4932e47321bd tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.146451 Jul 12 19:02:19.092966 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 566/1065] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:18 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:19.313458 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:19.314111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:19.320656 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:19.321108 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:19.321878 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:19.322324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:19.471146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:19.471146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7c1d4749-d35d-4401-b41c-7cf5a7e9bef0 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.161021 Jul 12 19:02:19.471146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 500/1066] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:19 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:20.110930 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:20.111646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:20.118422 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:20.118867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:20.119790 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:20.120222 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:20.486212 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:20.487820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:20.490725 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:20.494496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:20.494957 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:20.495764 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:20.496203 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:20.499176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-40f93ef2-4723-4226-99aa-1e63cdcb4622 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.393851 Jul 12 19:02:20.502070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 567/1067] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:20 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:20.636184 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:20.644651 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e816754c-c3db-4881-841a-5f02bf6bda12 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.162547 Jul 12 19:02:20.645216 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 501/1068] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:20 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:02:21.518241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:21.518849 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:21.521193 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:21.526064 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.526510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.527264 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.527772 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.659482 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:21.661834 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:21.662445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:21.664461 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:21.665244 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:21.667049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-023be467-5f76-4d50-b588-37ffc144057b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1507 microversion: 2.1 time: 0.153716 Jul 12 19:02:21.667708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 568/1069] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:21 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:02:21.670533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.670989 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.671805 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.673358 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.690757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:21.691458 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:21.698115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.698741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.699703 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.700273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.816914 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:21.824356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-78e0c4e3-a202-4267-b77c-eae464b8d78a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.166453 Jul 12 19:02:21.824927 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 502/1070] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:21 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:21.830063 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-70ae3871-5d2c-4c85-aee4-d8e7f0cebd98 req-09e9a084-436c-45ad-98ac-4f94d2ce7c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "name": "network-vif-unplugged", "status": "completed", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:21.837626 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-70ae3871-5d2c-4c85-aee4-d8e7f0cebd98 req-09e9a084-436c-45ad-98ac-4f94d2ce7c59 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.838085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-70ae3871-5d2c-4c85-aee4-d8e7f0cebd98 req-09e9a084-436c-45ad-98ac-4f94d2ce7c59 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.849502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.compute.server_external_events [req-70ae3871-5d2c-4c85-aee4-d8e7f0cebd98 req-09e9a084-436c-45ad-98ac-4f94d2ce7c59 service nova] Unable to find a host for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8. Dropping event network-vif-unplugged {{(pid=124970) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 12 19:02:21.850378 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-70ae3871-5d2c-4c85-aee4-d8e7f0cebd98 req-09e9a084-436c-45ad-98ac-4f94d2ce7c59 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024552 Jul 12 19:02:21.850987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 503/1071] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 12 19:02:21.961972 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-aca7581c-b501-4680-bade-384dd77453ec tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "POST /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8/action" status: 202 len: 0 microversion: 2.1 time: 0.275561 Jul 12 19:02:21.962563 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 569/1072] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Jul 12 19:02:21 2022] POST /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 12 19:02:21.971015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:21.971647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:21.977699 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.978388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:21.979417 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:21.980041 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:22.118483 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:22.127204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-aff5d861-d19d-42d8-9b1e-6e4742dd040a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1515 microversion: 2.1 time: 0.160432 Jul 12 19:02:22.128176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 504/1073] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:21 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:22.841852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:22.842459 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:22.848572 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:22.849016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:22.849767 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:22.850195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:22.979147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:22.986925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ba73b7d0-7abc-4774-9463-2f9a924d8a79 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.149541 Jul 12 19:02:22.987519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 570/1074] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:22 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:23.145005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:23.145695 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:23.152283 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:23.152796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:23.153687 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:23.154159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:23.282920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:23.290518 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-15c7994f-161d-466e-b0b4-f60d9f538dc2 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1515 microversion: 2.1 time: 0.149806 Jul 12 19:02:23.291080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 505/1075] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:23 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:24.004141 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:24.004957 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:24.011585 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:24.012037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:24.012908 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:24.013226 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:24.149521 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:24.157456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-86df8edb-2f4f-4e12-af3b-8659d7dec578 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.157412 Jul 12 19:02:24.158025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 571/1076] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:23 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:24.308080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:24.308724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:24.315649 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:24.316105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:24.316874 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:24.317315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:24.335206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:24.453214 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:24.461556 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ccbeee75-f4b9-4ae2-b118-36b4996f9856 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1517 microversion: 2.1 time: 0.157546 Jul 12 19:02:24.471948 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 506/1077] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:24 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:25.179658 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:25.180283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:25.186577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:25.187017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:25.187794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:25.188771 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:25.207956 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:25.326664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:25.334342 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-88f92481-fad8-40fb-9f11-d1da68ab0bb1 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.158658 Jul 12 19:02:25.334946 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 572/1078] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:25 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:25.484249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:25.484900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:25.492508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:25.492958 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:25.493900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:25.494153 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:25.659565 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:25.667329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-94363b24-76a5-499b-89b3-20ff01165ca4 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.187223 Jul 12 19:02:25.667929 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 507/1079] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:25 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:25.910287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-030d5a7f-8ffe-4144-b403-fc66aa5525e0 req-bc3fb924-7fde-4874-b576-d7db9c4fad97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13841344-7c55-4c40-9741-e41564d5e784", "name": "network-vif-plugged", "status": "completed", "tag": "04cbb2b7-c19f-4a61-bd78-ffa21c3580cc"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:25.920594 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-030d5a7f-8ffe-4144-b403-fc66aa5525e0 req-bc3fb924-7fde-4874-b576-d7db9c4fad97 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:25.921045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-030d5a7f-8ffe-4144-b403-fc66aa5525e0 req-bc3fb924-7fde-4874-b576-d7db9c4fad97 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:25.933152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-030d5a7f-8ffe-4144-b403-fc66aa5525e0 req-bc3fb924-7fde-4874-b576-d7db9c4fad97 service nova] Creating event network-vif-plugged:04cbb2b7-c19f-4a61-bd78-ffa21c3580cc for instance 13841344-7c55-4c40-9741-e41564d5e784 on hv-cinder-83538 Jul 12 19:02:25.938348 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-030d5a7f-8ffe-4144-b403-fc66aa5525e0 req-bc3fb924-7fde-4874-b576-d7db9c4fad97 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Jul 12 19:02:25.943208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 573/1080] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:26.350829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:26.351693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:26.358102 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:26.358630 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:26.359430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:26.359869 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:26.504910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:26.512850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1f76733a-ae3e-4788-9a57-e8b613ff49d4 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.165834 Jul 12 19:02:26.513444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 508/1081] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:26 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:26.686592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:26.687210 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:26.694684 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:26.695136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:26.695928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:26.696364 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:26.831266 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:26.839196 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6798ef43-1ad9-43a8-af9e-d6e1ed4e6dbb tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.157540 Jul 12 19:02:26.839791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 574/1082] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:26 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:27.531527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:27.532840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:27.539808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:27.540267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:27.541045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:27.541486 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:27.669377 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:27.676857 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7655bbff-4fd1-44aa-9334-c80ca8cda646 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.149345 Jul 12 19:02:27.677415 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 509/1083] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:27 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:27.856256 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:27.856802 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:27.863642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:27.864083 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:27.864828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:27.865254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:28.000017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:28.007588 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f43f42e1-bd0c-45a7-ba73-9427f048ae11 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.155265 Jul 12 19:02:28.008154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 575/1084] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:27 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:28.694610 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:28.695197 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:28.701772 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:28.702215 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:28.702995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:28.703457 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:28.833553 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:28.840876 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a1e83f86-a7b1-4441-8d80-7c7972e301cd tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1267 microversion: 2.1 time: 0.150174 Jul 12 19:02:28.841432 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 510/1085] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:28 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:29.024860 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:29.025471 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:29.032938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:29.033386 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:29.034196 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:29.034657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:29.167172 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:29.176250 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-24447354-fea3-4b36-a4d2-d01280d754bc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.155246 Jul 12 19:02:29.176838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 576/1086] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:29 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:29.857896 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:29.858500 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:29.865205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:29.865646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:29.866397 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:29.866826 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:29.999885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:30.008329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e454542b-becf-4a19-a458-fd2a8dfd4a99 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1455 microversion: 2.1 time: 0.154377 Jul 12 19:02:30.008903 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 511/1087] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:29 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:30.024474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:30.025104 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:30.031216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:30.031682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:30.032441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:30.032907 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:30.161707 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:30.169103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7d4a8b57-cbd6-4fb6-92b6-556a14ba1f74 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1455 microversion: 2.1 time: 0.148527 Jul 12 19:02:30.169665 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 577/1088] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:30 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:30.193202 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:30.193817 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:30.199760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:30.200183 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:30.200952 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:30.201388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:30.367762 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:30.377151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ba71325a-643a-4130-9c8e-7fa061e5bd3b tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.185740 Jul 12 19:02:30.377151 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 512/1089] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:30 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:31.393119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:31.393706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:31.400152 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:31.400590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:31.401344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:31.401853 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:31.537274 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:31.544948 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-17a6d8e0-6500-4bea-aef5-7b6e8d0ee909 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.156212 Jul 12 19:02:31.545508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 578/1090] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:31 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:32.183938 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-48e80ed5-8871-4e36-9eda-6ed016a13f80 req-1462125b-49f1-4617-9a84-cee88b7f4f5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13841344-7c55-4c40-9741-e41564d5e784", "tag": "04cbb2b7-c19f-4a61-bd78-ffa21c3580cc"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:32.193803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-48e80ed5-8871-4e36-9eda-6ed016a13f80 req-1462125b-49f1-4617-9a84-cee88b7f4f5d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:32.194363 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-48e80ed5-8871-4e36-9eda-6ed016a13f80 req-1462125b-49f1-4617-9a84-cee88b7f4f5d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:32.206488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-48e80ed5-8871-4e36-9eda-6ed016a13f80 req-1462125b-49f1-4617-9a84-cee88b7f4f5d service nova] Creating event network-changed:04cbb2b7-c19f-4a61-bd78-ffa21c3580cc for instance 13841344-7c55-4c40-9741-e41564d5e784 on hv-cinder-83538 Jul 12 19:02:32.211758 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-48e80ed5-8871-4e36-9eda-6ed016a13f80 req-1462125b-49f1-4617-9a84-cee88b7f4f5d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031449 Jul 12 19:02:32.212600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 513/1091] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:32.562561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:32.563721 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:32.573842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:32.573842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:32.573842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:32.573842 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:32.781636 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:32.790667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4f423fd3-09e7-4e4f-9955-237bf27356ef tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.232187 Jul 12 19:02:32.791240 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 579/1092] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:32 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:33.809657 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:33.810362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:33.816839 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:33.817289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:33.818055 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:33.818492 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:33.950768 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:33.958908 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8e0a2db3-4354-4a46-8489-7a472e4df1b0 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.154015 Jul 12 19:02:33.959517 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 514/1093] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:33 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:34.976370 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:34.977018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:34.983570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:34.984017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:34.984774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:34.985978 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:35.123559 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:35.132974 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b3635e33-53ab-40e1-a899-2f8dc97c3d2e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.158478 Jul 12 19:02:35.132974 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 580/1094] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:34 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:36.148703 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:36.149316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:36.156205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:36.156654 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:36.157978 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:36.158404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:36.296615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:36.305292 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-962413a9-4920-41ae-86f8-0aba8d078b0e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.160449 Jul 12 19:02:36.305984 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 515/1095] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:36 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:37.322901 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:37.323544 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:37.325794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=55 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:37.331121 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:37.331592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:37.332350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:37.332785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:37.463783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:37.471764 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c834f7ce-26da-4dbe-bc92-03153d164511 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.152751 Jul 12 19:02:37.472333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 581/1096] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:37 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:37.899903 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-3c62ce0a-5d8b-426b-9b34-ba46cbe24ced req-90ca8bc0-7649-4898-ac02-4cdbf8dda508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "name": "network-vif-plugged", "status": "completed", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:37.905016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:37.909979 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-3c62ce0a-5d8b-426b-9b34-ba46cbe24ced req-90ca8bc0-7649-4898-ac02-4cdbf8dda508 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:37.910427 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-3c62ce0a-5d8b-426b-9b34-ba46cbe24ced req-90ca8bc0-7649-4898-ac02-4cdbf8dda508 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:37.922016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-3c62ce0a-5d8b-426b-9b34-ba46cbe24ced req-90ca8bc0-7649-4898-ac02-4cdbf8dda508 service nova] Creating event network-vif-plugged:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 19:02:37.927893 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-3c62ce0a-5d8b-426b-9b34-ba46cbe24ced req-90ca8bc0-7649-4898-ac02-4cdbf8dda508 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031852 Jul 12 19:02:37.928475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 516/1097] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:38.488650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:38.489257 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:38.495927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:38.501435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:38.501435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:38.501435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:38.626656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:38.634375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-044745bf-3b8a-482d-baa9-e150b3be9da9 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.149614 Jul 12 19:02:38.635911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 582/1098] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:38 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:39.472310 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:39.472900 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:39.479651 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.480105 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.480873 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.481315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.504998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a469340a-bcf0-4d33-85fc-f0fce9dd66ce tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/ips" status: 200 len: 150 microversion: 2.1 time: 0.037993 Jul 12 19:02:39.505496 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 517/1099] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 19:02:39 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:39.516215 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3acaea36-fca2-4082-a934-09ad10b6735d"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:39.517295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:39.524309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.528120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.528120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.528120 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.603175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: POST /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/os-volume_attachments HTTP/1.1 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 74 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:02:39.604915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {"volumeAttachment": {"volumeId": "3acaea36-fca2-4082-a934-09ad10b6735d"}} Jul 12 19:02:39.606669 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'server_id': '7693fc25-26b5-4079-8624-85c79bf6ee39', 'body': {'volumeAttachment': {'volumeId': '3acaea36-fca2-4082-a934-09ad10b6735d'}}} Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:39.607621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:39.609067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 400 to user: Invalid volume: volume 3acaea36-fca2-4082-a934-09ad10b6735d is already attached to instances: 9c043ae0-a1b7-4574-a5c2-9525063c3229 {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-70672aeb-e05c-4e45-b231-04d754d0cc9c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094422 Jul 12 19:02:39.611053 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 583/1100] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 19:02:39 2022] POST /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 19:02:39.615005 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:39.615529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:39.621760 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.622208 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.622963 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.623422 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.648158 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:02:39.652261 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:39.652896 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:39.660398 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.660835 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.661582 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.662012 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.795935 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:39.803999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0b385fc4-76d4-4cc2-9147-deb67937d05c tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1573 microversion: 2.1 time: 0.155497 Jul 12 19:02:39.805719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 584/1101] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:39 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:39.947320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bdd2a7f7-14f7-4234-a922-8f989c7d9cc8 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 204 len: 0 microversion: 2.1 time: 0.335798 Jul 12 19:02:39.947924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 518/1102] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:02:39 2022] DELETE /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 12 19:02:39.956941 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:39.957546 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:39.963596 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.964027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:39.964781 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:39.965211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:40.094500 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:40.102025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5627dd41-3ff2-4cde-b236-4a37128b21be tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1680 microversion: 2.1 time: 0.149770 Jul 12 19:02:40.102562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 585/1103] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:39 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:40.822255 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:40.822991 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:40.829835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:40.830291 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:40.831062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:40.831605 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:40.972143 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:40.979784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-502b5c60-5b4f-4c1c-9a83-6b6c3bdd254d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1560 microversion: 2.1 time: 0.161756 Jul 12 19:02:40.980356 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 519/1104] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:40 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:41.119190 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:41.119769 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:41.128646 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:41.129089 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:41.129844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:41.130277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:41.267575 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:41.275057 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8f19e11a-946b-4c64-a696-1faf0588e344 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1680 microversion: 2.1 time: 0.159830 Jul 12 19:02:41.275657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 586/1105] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:41 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:42.292965 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:42.293592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:42.300049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:42.301488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:42.301488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:42.301832 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:42.535748 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:42.543442 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-001ffc50-070b-42fb-92e7-196a77f32346 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1680 microversion: 2.1 time: 0.254246 Jul 12 19:02:42.544285 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 520/1106] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:42 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:02:43.215827 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-433520a8-4429-416a-a451-1c525ad16155 req-185afc8d-9a20-4b57-ab2a-e346d4db6eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7693fc25-26b5-4079-8624-85c79bf6ee39", "name": "network-vif-deleted", "tag": "1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:43.223737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-433520a8-4429-416a-a451-1c525ad16155 req-185afc8d-9a20-4b57-ab2a-e346d4db6eb9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:43.224185 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-433520a8-4429-416a-a451-1c525ad16155 req-185afc8d-9a20-4b57-ab2a-e346d4db6eb9 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:43.235454 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-433520a8-4429-416a-a451-1c525ad16155 req-185afc8d-9a20-4b57-ab2a-e346d4db6eb9 service nova] Creating event network-vif-deleted:1099e98e-6a11-44fb-a0a0-2e1ef2ee6fb9 for instance 7693fc25-26b5-4079-8624-85c79bf6ee39 on hv-cinder-83538 Jul 12 19:02:43.240693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-433520a8-4429-416a-a451-1c525ad16155 req-185afc8d-9a20-4b57-ab2a-e346d4db6eb9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029947 Jul 12 19:02:43.241288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 587/1107] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:43.560563 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:43.561313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:43.569041 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:43.569775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:43.570557 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:43.570994 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:43.603176 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:43.603662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:43.604115 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'fault' on Instance uuid 7693fc25-26b5-4079-8624-85c79bf6ee39 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:02:43.646245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:43.654059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e1502c7d-bf5f-4cb3-947b-7ef5b6f64721 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 200 len: 1329 microversion: 2.1 time: 0.097495 Jul 12 19:02:43.654631 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 521/1108] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:43 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:44.673436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:44.674568 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:44.680791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:44.681243 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:44.682009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:44.682449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:44.696030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 HTTP/1.1 Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:02:44.697632 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:02:44.699334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '7693fc25-26b5-4079-8624-85c79bf6ee39'} Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:02:44.700301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:02:44.701851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:44.703268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:02:44.703268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ae95fca8-bece-4f87-b656-3f319b9c6abc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 404 len: 111 microversion: 2.1 time: 0.030991 Jul 12 19:02:44.703268 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 588/1109] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:44 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:02:44.707931 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f8be2f2a-a0c0-40ee-a683-447b2268a22b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '.version_select at 0x7f017840f3a0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:44.770402 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f8be2f2a-a0c0-40ee-a683-447b2268a22b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90443879" status: 202 len: 0 microversion: 2.1 time: 0.066291 Jul 12 19:02:44.770969 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 522/1110] 10.222.0.59 () {58 vars in 1214 bytes} [Tue Jul 12 19:02:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90443879 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:02:45.788774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:45.789292 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:45.796282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:45.796732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:45.797489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:45.797968 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:45.882078 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'services' on Instance uuid 9c043ae0-a1b7-4574-a5c2-9525063c3229 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:02:46.031375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-79fde0ac-d246-4b7e-a9f6-e14fa355e35a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments/3acaea36-fca2-4082-a934-09ad10b6735d" status: 202 len: 0 microversion: 2.1 time: 0.246299 Jul 12 19:02:46.032187 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 589/1111] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 19:02:45 2022] DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments/3acaea36-fca2-4082-a934-09ad10b6735d => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:02:46.041194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:46.042194 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:46.049277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:46.049735 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:46.050612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:46.051038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:46.078722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:46.084357 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8b6e0a69-5e24-49a3-b590-45e41b501cc5 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Jul 12 19:02:46.084939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 523/1112] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:02:46 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:47.101967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:47.101967 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:47.105204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:47.105656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:47.106414 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:47.106848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:47.123075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:02:47.135675 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e77500c6-11b6-4092-beff-bc70017bc48b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Jul 12 19:02:47.136227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 590/1113] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:02:47 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:48.148153 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:48.149079 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:48.155974 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.156425 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.157677 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.158210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.186691 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a3109d47-d162-431a-b83c-2708541bb380 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042865 Jul 12 19:02:48.187167 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 524/1114] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:02:48 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 19:02:48.244127 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:48.244627 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:48.251828 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.252273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.254945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.254945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.278555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:02:48.550324 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-edbc653c-6d4c-4ec2-8c83-dafe7873e8d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 204 len: 0 microversion: 2.1 time: 0.309631 Jul 12 19:02:48.551027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 591/1115] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:02:48 2022] DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:02:48.559528 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:48.564317 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:48.567481 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.567934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.568727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:48.569163 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:48.699770 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:48.708108 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ff03b757-1027-47e1-864c-e11c979ac892 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1679 microversion: 2.1 time: 0.152863 Jul 12 19:02:48.708669 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 525/1116] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:48 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:49.726381 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:49.727081 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:49.733783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:49.734228 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:49.734981 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:49.735570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:49.861840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:49.869291 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-970bbafd-d10e-403a-8ffb-3ca0269c163f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1679 microversion: 2.1 time: 0.147147 Jul 12 19:02:49.869866 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 592/1117] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:49 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:50.887475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:50.888120 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:50.895531 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:50.895975 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:50.896724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:50.897152 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:51.158245 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:51.166048 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-954593dc-1f7c-4e52-bbf6-5d9c9b9af655 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1679 microversion: 2.1 time: 0.282421 Jul 12 19:02:51.166682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 526/1118] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:50 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1679 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:52.088211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-c2f2195e-04e1-4c37-b6f9-f9c89c01e011 req-99574e6d-4bd1-4680-b830-cc4b047038d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c043ae0-a1b7-4574-a5c2-9525063c3229", "name": "network-vif-deleted", "tag": "ae6e5b62-8b06-4b04-846a-c2094b9d7ef4"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:52.099116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-c2f2195e-04e1-4c37-b6f9-f9c89c01e011 req-99574e6d-4bd1-4680-b830-cc4b047038d3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:52.099116 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-c2f2195e-04e1-4c37-b6f9-f9c89c01e011 req-99574e6d-4bd1-4680-b830-cc4b047038d3 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:52.112446 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-c2f2195e-04e1-4c37-b6f9-f9c89c01e011 req-99574e6d-4bd1-4680-b830-cc4b047038d3 service nova] Creating event network-vif-deleted:ae6e5b62-8b06-4b04-846a-c2094b9d7ef4 for instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 on hv-cinder-83538 Jul 12 19:02:52.117489 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-c2f2195e-04e1-4c37-b6f9-f9c89c01e011 req-99574e6d-4bd1-4680-b830-cc4b047038d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033179 Jul 12 19:02:52.118271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 593/1119] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:52.183582 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:52.184836 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:52.192583 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:52.193365 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:52.194324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:52.194952 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:52.272690 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:52.284273 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2431ec20-eae8-4550-a5cd-03efc4b2137d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 200 len: 1611 microversion: 2.1 time: 0.104770 Jul 12 19:02:52.285007 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 527/1120] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:52 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 1611 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:02:53.303115 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:53.303971 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:53.311007 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:53.311589 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:53.312250 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:53.312679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:53.326657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 HTTP/1.1 Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:02:53.328361 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:02:53.330195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '9c043ae0-a1b7-4574-a5c2-9525063c3229'} Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:02:53.331128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:02:53.332685 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:02:53.334155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:02:53.334155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2b95ccae-ad9c-400b-96f8-8eecac1d0da9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 404 len: 111 microversion: 2.1 time: 0.030776 Jul 12 19:02:53.334155 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 594/1121] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:53 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:02:53.338608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-91655265-394b-4c81-93ec-0092ad641c83 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '.version_select at 0x7f0178723e50>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:53.426276 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-91655265-394b-4c81-93ec-0092ad641c83 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139301657" status: 202 len: 0 microversion: 2.1 time: 0.091417 Jul 12 19:02:53.426883 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 528/1122] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Jul 12 19:02:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139301657 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:02:54.159054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b82878ac-c27a-42f4-bf8c-2b90dc74edb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: .version_select at 0x7f0178461430>, body: {"keypair": {"name": "tempest-keypair-1476406576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiTvlMYHXfYk4iWQ9FATYTI/TzYc9tymd4zOo+tAn9w46ZTl73Rp/ukOLYTIAZY+963KAkZFffUWI9L46UmhRwS3wHhWQsXIOZ9BsTD/r05jMBnel6CoqY+O6Gou3NOSA=="}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:54.175052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-b82878ac-c27a-42f4-bf8c-2b90dc74edb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:02:54.178938 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-b82878ac-c27a-42f4-bf8c-2b90dc74edb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:02:54.273555 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b82878ac-c27a-42f4-bf8c-2b90dc74edb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118989 Jul 12 19:02:54.274163 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 595/1123] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 19:02:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:02:56.569945 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2090100204", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae8b0f6-4fda-4639-886a-ca703e1b912a"}], "security_groups": [{"name": "tempest-securitygroup--1926137768"}], "key_name": "tempest-keypair-1476406576", "user_data": "}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:02:56.672549 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.network.neutron [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] validate_networks() for [('cae8b0f6-4fda-4639-886a-ca703e1b912a', None, None, None, None, None)] {{(pid=124970) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 19:02:57.041866 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 19:02:57.042308 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image limits 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 19:02:57.042798 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 19:02:57.043206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image pref 0:0:0 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 19:02:57.043667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.virt.hardware [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 19:02:57.053444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:57.053881 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:57.054667 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:57.055094 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:57.071813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:02:57.075828 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:02:57.087260 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Going to run 1 instances... {{(pid=124970) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 19:02:57.089535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 19:02:57.217846 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-eeb0452e-9ff9-4618-b981-8b38a4bd898d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.652214 Jul 12 19:02:57.218607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 529/1124] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 19:02:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 19:02:57.229414 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-78d4153b-45a2-4f0e-9f79-ebe791397946 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:57.234058 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-78d4153b-45a2-4f0e-9f79-ebe791397946 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:57.339295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-78d4153b-45a2-4f0e-9f79-ebe791397946 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:57.347438 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-78d4153b-45a2-4f0e-9f79-ebe791397946 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1242 microversion: 2.1 time: 0.122181 Jul 12 19:02:57.348457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 596/1125] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:57 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:58.365533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:58.366138 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:58.373284 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:58.373737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:58.374508 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:58.374952 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:58.440672 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:58.449275 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-80bb5409-c024-4556-9cf0-5701e42e774f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1246 microversion: 2.1 time: 0.088523 Jul 12 19:02:58.449825 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 530/1126] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:58 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:02:59.467768 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:02:59.468466 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:02:59.475643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:59.476182 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:59.477025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:02:59.477462 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:02:59.557573 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:02:59.565736 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-677b7ece-33bd-40dc-a5df-7709b125b600 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1300 microversion: 2.1 time: 0.101964 Jul 12 19:02:59.566356 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 597/1127] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:02:59 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:00.581995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:00.583263 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:00.589114 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:00.589579 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:00.590323 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:00.590757 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:00.809290 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:00.817226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-d10d2285-69a3-4937-be2a-5fc449ae6314 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.239096 Jul 12 19:03:00.817808 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 531/1128] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:00 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:01.013451 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-69502b4a-89e8-49f0-9684-d2da6afe7685 req-56b67f1f-790f-4fcb-8622-700c469a5a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e48c87-f65d-46c5-8bb8-629de6e212c8", "tag": "261547b7-6b53-4515-97d0-0c0a4f515365"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:03:01.023995 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-69502b4a-89e8-49f0-9684-d2da6afe7685 req-56b67f1f-790f-4fcb-8622-700c469a5a25 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:01.024577 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-69502b4a-89e8-49f0-9684-d2da6afe7685 req-56b67f1f-790f-4fcb-8622-700c469a5a25 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:01.038326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-69502b4a-89e8-49f0-9684-d2da6afe7685 req-56b67f1f-790f-4fcb-8622-700c469a5a25 service nova] Creating event network-changed:261547b7-6b53-4515-97d0-0c0a4f515365 for instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 on hv-cinder-83538 Jul 12 19:03:01.043474 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-69502b4a-89e8-49f0-9684-d2da6afe7685 req-56b67f1f-790f-4fcb-8622-700c469a5a25 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034888 Jul 12 19:03:01.044141 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 598/1129] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:03:01.834679 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:01.835292 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:01.841907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:01.842362 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:01.843949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:01.843949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:02.059165 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:02.067870 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-54c3838f-6c3e-4967-9ffa-033eff6e80ec tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.237160 Jul 12 19:03:02.068447 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 532/1130] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:01 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:03.086538 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:03.087259 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:03.093856 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:03.094344 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:03.095282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:03.095737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:03.227455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:03.235785 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-eda5a4a8-777c-4adb-91a5-b883052d1825 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.153060 Jul 12 19:03:03.236430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 599/1131] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:03 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:04.252892 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:04.253506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:04.260057 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:04.260509 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:04.261274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:04.261712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:04.395154 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:04.402725 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-0e4718d6-2e39-4803-a449-99a5c6db39b9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.153986 Jul 12 19:03:04.403287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 533/1132] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:04 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:05.420457 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:05.421069 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:05.428406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:05.428848 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:05.429592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:05.430018 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:05.556311 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:05.563852 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f4da8520-e4aa-4a93-8218-d2d821157ebe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.147296 Jul 12 19:03:05.564462 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 600/1133] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:05 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:06.580374 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:06.580990 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:06.587758 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:06.588231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:06.588999 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:06.589436 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:06.722910 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:06.730352 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2d538ed5-347e-4894-96f8-af7dbe0b9fa7 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.154164 Jul 12 19:03:06.730992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 534/1134] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:06 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:07.747604 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:07.748211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:07.750890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:07.751639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:07.756456 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:07.756898 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:07.757664 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:07.758103 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:07.887951 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:07.896276 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0a1ec236-7230-4459-a56a-fe5471f9a77b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.152568 Jul 12 19:03:07.896840 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 601/1135] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:07 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:08.125016 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-268ef914-f79a-49cd-844a-56c621b89635 req-fd9b07c3-d17b-41f9-b589-10c4987db24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e48c87-f65d-46c5-8bb8-629de6e212c8", "name": "network-vif-plugged", "status": "completed", "tag": "261547b7-6b53-4515-97d0-0c0a4f515365"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:03:08.129383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=2 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:08.130045 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:08.135986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-268ef914-f79a-49cd-844a-56c621b89635 req-fd9b07c3-d17b-41f9-b589-10c4987db24c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:08.137222 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-268ef914-f79a-49cd-844a-56c621b89635 req-fd9b07c3-d17b-41f9-b589-10c4987db24c service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:08.147453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-268ef914-f79a-49cd-844a-56c621b89635 req-fd9b07c3-d17b-41f9-b589-10c4987db24c service nova] Creating event network-vif-plugged:261547b7-6b53-4515-97d0-0c0a4f515365 for instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 on hv-cinder-83538 Jul 12 19:03:08.152459 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-268ef914-f79a-49cd-844a-56c621b89635 req-fd9b07c3-d17b-41f9-b589-10c4987db24c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031274 Jul 12 19:03:08.153040 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 535/1136] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:03:08.913796 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:08.914350 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:08.920969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:08.921424 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:08.922494 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:08.922989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:09.054561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:09.062135 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b9a4b466-d0df-460e-8d40-5a54b1a0ef1d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.152236 Jul 12 19:03:09.062762 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 602/1137] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:08 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:03:10.082803 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:10.083576 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:10.085802 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:03:10.091535 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:10.092206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:10.092976 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:10.093405 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:10.225955 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:10.233386 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9a561e28-634a-46ff-9537-90cdec2e6b72 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1368 microversion: 2.1 time: 0.155869 Jul 12 19:03:10.233946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 536/1138] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:10 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:03:11.251492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:11.252146 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:11.258851 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:11.259295 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:11.260097 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:11.260530 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:11.461449 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:03:11.469645 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-db3705a3-42ca-4682-8fc8-1de1e3d8e5c0 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1558 microversion: 2.1 time: 0.222697 Jul 12 19:03:11.470157 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 603/1139] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:03:11 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:03:11.487076 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:03:11.487618 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:03:11.494977 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:11.495470 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:11.496243 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:11.496707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:11.837674 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-401b1365-71de-4596-9ba6-3c9945219fca tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.355599 Jul 12 19:03:11.838274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 537/1140] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 19:03:11 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-interface => generated 285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:03:12.806631 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-9e61865f-cdbc-44e8-beb8-713aac74fcd1 req-f3f3eb26-6f49-424b-bcda-0519b21a58ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e48c87-f65d-46c5-8bb8-629de6e212c8", "tag": "261547b7-6b53-4515-97d0-0c0a4f515365"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:03:12.814937 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-9e61865f-cdbc-44e8-beb8-713aac74fcd1 req-f3f3eb26-6f49-424b-bcda-0519b21a58ab service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:03:12.815430 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-9e61865f-cdbc-44e8-beb8-713aac74fcd1 req-f3f3eb26-6f49-424b-bcda-0519b21a58ab service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:03:12.826066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-9e61865f-cdbc-44e8-beb8-713aac74fcd1 req-f3f3eb26-6f49-424b-bcda-0519b21a58ab service nova] Creating event network-changed:261547b7-6b53-4515-97d0-0c0a4f515365 for instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 on hv-cinder-83538 Jul 12 19:03:12.831486 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-9e61865f-cdbc-44e8-beb8-713aac74fcd1 req-f3f3eb26-6f49-424b-bcda-0519b21a58ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028446 Jul 12 19:03:12.832254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 604/1141] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:19.654885 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=68 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:19.659620 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=3 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:19.659754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=7 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:19.659754 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:19.660382 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:19.660915 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:19.667221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:19.667708 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:19.668640 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:19.669082 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:19.696687 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:04:19.728313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-b95b00db-c07c-481c-89f4-50b589fa066d req-2e365e15-3031-4c56-ae35-0806dd933593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:19.736794 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-b95b00db-c07c-481c-89f4-50b589fa066d req-2e365e15-3031-4c56-ae35-0806dd933593 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:19.737311 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-b95b00db-c07c-481c-89f4-50b589fa066d req-2e365e15-3031-4c56-ae35-0806dd933593 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:19.748518 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-b95b00db-c07c-481c-89f4-50b589fa066d req-2e365e15-3031-4c56-ae35-0806dd933593 service nova] Creating event network-changed:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 19:04:19.754737 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-b95b00db-c07c-481c-89f4-50b589fa066d req-2e365e15-3031-4c56-ae35-0806dd933593 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098872 Jul 12 19:04:19.755375 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 605/1142] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:20.006231 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-365d5778-cd7a-4895-b132-a178ad4cff83 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 204 len: 0 microversion: 2.1 time: 0.353161 Jul 12 19:04:20.007157 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 538/1143] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:04:19 2022] DELETE /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:04:20.017020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:20.018128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:20.026547 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:20.027080 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:20.027977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:20.028607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:20.164562 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:20.172307 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-066614ff-0fc9-436d-99ca-b0d9f02ec3f7 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.160622 Jul 12 19:04:20.172911 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 606/1144] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:20 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:21.190941 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:21.191663 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:21.198049 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:21.198488 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:21.199232 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:21.199758 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:21.415594 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:21.423647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b97248d4-c35d-4fb7-8dd3-355e0b5de641 tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1566 microversion: 2.1 time: 0.237082 Jul 12 19:04:21.424325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 539/1145] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:21 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1566 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:22.441312 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:22.444633 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:22.448519 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:22.448973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:22.449800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:22.450235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:22.540634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:22.550300 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7197ebe0-b517-4d68-9fa9-453a342d221d tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1380 microversion: 2.1 time: 0.113702 Jul 12 19:04:22.551037 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 607/1146] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:22 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1380 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:22.554313 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-1c3ab985-a5e9-40f0-ace2-67790f1ec4b4 req-1a2498b3-40cf-489a-8962-670d77c273f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2ef7557-2e4e-4091-a6ab-e0abb25650c8", "name": "network-vif-deleted", "tag": "b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:22.562744 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1c3ab985-a5e9-40f0-ace2-67790f1ec4b4 req-1a2498b3-40cf-489a-8962-670d77c273f5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:22.563185 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-1c3ab985-a5e9-40f0-ace2-67790f1ec4b4 req-1a2498b3-40cf-489a-8962-670d77c273f5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:22.574814 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-1c3ab985-a5e9-40f0-ace2-67790f1ec4b4 req-1a2498b3-40cf-489a-8962-670d77c273f5 service nova] Creating event network-vif-deleted:b5dcb1e5-30b2-4b2e-af40-74e44bdf95fa for instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 on hv-cinder-83538 Jul 12 19:04:22.580469 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-1c3ab985-a5e9-40f0-ace2-67790f1ec4b4 req-1a2498b3-40cf-489a-8962-670d77c273f5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 Jul 12 19:04:22.581059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 540/1147] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 19:04:23.567854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:23.568455 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:23.574934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:23.575413 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:23.578020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:23.578020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:23.607651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:23.608287 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:23.608739 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lazy-loading 'fault' on Instance uuid a2ef7557-2e4e-4091-a6ab-e0abb25650c8 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:04:23.650358 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf2b0ab2f9f4d939c22754c0c64efd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c708b3a3006049469e7379b68d7b9e94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:23.657940 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b7590e47-3d9f-4a5e-b0d2-b1e13783e8cc tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 200 len: 1223 microversion: 2.1 time: 0.094521 Jul 12 19:04:23.658505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 608/1148] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:23 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:24.676213 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:24.676918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] [instance: a2ef7557-2e4e-4091-a6ab-e0abb25650c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:24.683684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:24.684135 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:24.684894 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:24.685324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:24.698752 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] HTTP exception thrown: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Request method failure captured: Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 HTTP/1.1 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRGyWElQ9VVCzqzPKSTqMUn5Sz_7MFR9TFlKHO2bMgypIBNLHL3HvnAB9cTieNkg4kBPvU3M9lBPgzrGSOd_re9bdGJ8tdaVQaDTAuXIW2yVomX3u_MIDrehJ4ya7sqbhr2TUTVZ7fOtWhglod32TdP2HOnfTd4tdVRcGakVpqx5fA Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: c708b3a3006049469e7379b68d7b9e94 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestShelveInstance-32425018 Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:04:24.700381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c708b3a3006049469e7379b68d7b9e94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c708b3a3006049469e7379b68d7b9e94", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c708b3a3006049469e7379b68d7b9e94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c708b3a3006049469e7379b68d7b9e94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestShelveInstance-32425018 Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: c708b3a3006049469e7379b68d7b9e94 Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestShelveInstance-32425018 Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestShelveInstance-32425018-project Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: aaf2b0ab2f9f4d939c22754c0c64efd2 Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestShelveInstance-32425018-project Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. Jul 12 19:04:24.701823 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'a2ef7557-2e4e-4091-a6ab-e0abb25650c8'} Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:24.702717 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. Jul 12 19:04:24.704444 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:24.706682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Returning 404 to user: Instance a2ef7557-2e4e-4091-a6ab-e0abb25650c8 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:24.706682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9d90b37b-a1d1-488c-86d7-b89d95e1353a tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8" status: 404 len: 111 microversion: 2.1 time: 0.029762 Jul 12 19:04:24.706682 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 541/1149] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:24 2022] GET /compute/v2.1/servers/a2ef7557-2e4e-4091-a6ab-e0abb25650c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:04:24.948688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-04ab5417-6f22-47d0-97b9-88d8fae3245e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] Calling method '.version_select at 0x7f01784c0940>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:25.042019 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-04ab5417-6f22-47d0-97b9-88d8fae3245e tempest-TestShelveInstance-32425018 tempest-TestShelveInstance-32425018-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286659698" status: 202 len: 0 microversion: 2.1 time: 0.097099 Jul 12 19:04:25.042540 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 609/1150] 10.222.0.59 () {58 vars in 1250 bytes} [Tue Jul 12 19:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-286659698 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:04:27.807607 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:27.808132 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:27.814295 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:27.815395 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:27.816022 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:27.816453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:27.840907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-96167d1a-d809-4768-80f8-cc2840b7b94f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/ips" status: 200 len: 150 microversion: 2.1 time: 0.093473 Jul 12 19:04:27.841918 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 542/1151] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 19:04:27 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:30.499284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7375d100-7cf5-4edc-9fea-4b5a48466c5b"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:30.500461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:30.512649 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:30.513221 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:30.514039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:30.514467 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:31.290820 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-978e2025-dfae-45b2-bbb0-69557145dd50 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796200 Jul 12 19:04:31.291498 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 610/1152] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 19:04:30 2022] POST /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:32.927886 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:32.928383 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:32.929318 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-6b299d7a-8f84-4b38-b1c9-7f293706ffa7 req-4c9eed49-a30f-4e4c-9839-8e3d01b40f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13841344-7c55-4c40-9741-e41564d5e784", "tag": "04cbb2b7-c19f-4a61-bd78-ffa21c3580cc"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:32.936964 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:32.937600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:32.941471 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:32.941471 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:32.954674 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6b299d7a-8f84-4b38-b1c9-7f293706ffa7 req-4c9eed49-a30f-4e4c-9839-8e3d01b40f0a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:32.955136 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6b299d7a-8f84-4b38-b1c9-7f293706ffa7 req-4c9eed49-a30f-4e4c-9839-8e3d01b40f0a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:32.966615 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:04:32.971900 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-6b299d7a-8f84-4b38-b1c9-7f293706ffa7 req-4c9eed49-a30f-4e4c-9839-8e3d01b40f0a service nova] Creating event network-changed:04cbb2b7-c19f-4a61-bd78-ffa21c3580cc for instance 13841344-7c55-4c40-9741-e41564d5e784 on hv-cinder-83538 Jul 12 19:04:32.973434 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-6b299d7a-8f84-4b38-b1c9-7f293706ffa7 req-4c9eed49-a30f-4e4c-9839-8e3d01b40f0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048259 Jul 12 19:04:32.985845 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 611/1153] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:33.230781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-14d54902-1e48-4d1a-afbc-116371f83f01 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "DELETE /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 204 len: 0 microversion: 2.1 time: 0.308341 Jul 12 19:04:33.231773 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 543/1154] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:04:32 2022] DELETE /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:04:33.241713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:33.242560 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:33.248983 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:33.249505 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:33.250487 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:33.251067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:33.434989 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:33.447241 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-31f198dd-c9a4-41cd-ab74-8f6c869fb6cb tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1579 microversion: 2.1 time: 0.210697 Jul 12 19:04:33.447854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 612/1155] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:33 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1579 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:34.466002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:34.467277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:34.474080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:34.474533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:34.475338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:34.475781 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:34.657992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:34.665882 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b47ddd90-896e-48a2-838b-ff04a39dc631 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1579 microversion: 2.1 time: 0.204134 Jul 12 19:04:34.666468 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 544/1156] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:34 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1579 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:04:35.636119 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-9c269689-e470-47ce-8e18-ed128f8a7078 req-3d10c1e6-80f9-473b-9513-2356e1e08c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13841344-7c55-4c40-9741-e41564d5e784", "name": "network-vif-deleted", "tag": "04cbb2b7-c19f-4a61-bd78-ffa21c3580cc"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:35.644956 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-9c269689-e470-47ce-8e18-ed128f8a7078 req-3d10c1e6-80f9-473b-9513-2356e1e08c9a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:35.645426 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-9c269689-e470-47ce-8e18-ed128f8a7078 req-3d10c1e6-80f9-473b-9513-2356e1e08c9a service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:35.656334 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-9c269689-e470-47ce-8e18-ed128f8a7078 req-3d10c1e6-80f9-473b-9513-2356e1e08c9a service nova] Creating event network-vif-deleted:04cbb2b7-c19f-4a61-bd78-ffa21c3580cc for instance 13841344-7c55-4c40-9741-e41564d5e784 on hv-cinder-83538 Jul 12 19:04:35.661583 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-9c269689-e470-47ce-8e18-ed128f8a7078 req-3d10c1e6-80f9-473b-9513-2356e1e08c9a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029108 Jul 12 19:04:35.662153 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 613/1157] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:35.682983 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:35.683619 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:35.690129 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:35.690574 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:35.691361 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:35.691795 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:35.756277 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:35.763768 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bc89147c-6f6a-4539-8f9a-ff56c2c50378 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1393 microversion: 2.1 time: 0.084618 Jul 12 19:04:35.764336 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 545/1158] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:35 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1393 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:36.782326 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:36.783034 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:36.789252 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:36.789691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:36.790440 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:36.790867 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:36.821915 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:36.822165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:36.822603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lazy-loading 'fault' on Instance uuid 13841344-7c55-4c40-9741-e41564d5e784 {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:04:36.864556 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:36.872269 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-6841ba53-9371-4e2d-9224-591f060146e9 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 200 len: 1231 microversion: 2.1 time: 0.094639 Jul 12 19:04:36.873023 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 614/1159] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:36 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:37.889160 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:37.889783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 13841344-7c55-4c40-9741-e41564d5e784] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:37.897423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:37.897911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:37.898680 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:37.899258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:37.912521 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] HTTP exception thrown: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Request method failure captured: Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 HTTP/1.1 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcOzd2wPHK6Nq4QFFBIslLU18ZYkdz8YY_tLPrVyuWcP-ufNFzx05vUOENVikowZKNLWyfPAxa7McntpnstfDPSvH1bj5Yqub7qRL132BMcebFg8gu78HIJ01ZKsuqoS4Cws5BZlJl0xrRv04o2ZkY_RDz3Pv4wKC1vO2m7_TY317kI Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:04:37.914201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f20a43af9cc4c68904ba717560e3789", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 584b15b723a94f8bb380b76a2db97fc8 Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. Jul 12 19:04:37.915884 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '13841344-7c55-4c40-9741-e41564d5e784'} Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:37.916774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. Jul 12 19:04:37.918289 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:37.919707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Returning 404 to user: Instance 13841344-7c55-4c40-9741-e41564d5e784 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:37.919707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9e6d7065-7a07-499a-86ce-ccec082f894a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784" status: 404 len: 111 microversion: 2.1 time: 0.030370 Jul 12 19:04:37.919707 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 546/1160] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:37 2022] GET /compute/v2.1/servers/13841344-7c55-4c40-9741-e41564d5e784 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:04:39.889536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7375d100-7cf5-4edc-9fea-4b5a48466c5b"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:39.890872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:39.897405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:39.900043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:39.900043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:39.900043 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:39.980729 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: POST /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments HTTP/1.1 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 74 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:04:39.985299 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {"volumeAttachment": {"volumeId": "7375d100-7cf5-4edc-9fea-4b5a48466c5b"}} Jul 12 19:04:39.987128 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'server_id': '68e48c87-f65d-46c5-8bb8-629de6e212c8', 'body': {'volumeAttachment': {'volumeId': '7375d100-7cf5-4edc-9fea-4b5a48466c5b'}}} Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:39.988110 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:39.989639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 400 to user: Invalid volume: volume 7375d100-7cf5-4edc-9fea-4b5a48466c5b is already attached to instances: 68e48c87-f65d-46c5-8bb8-629de6e212c8 {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b0af5f13-2d56-498c-acac-73c522d8eb57 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098616 Jul 12 19:04:39.991428 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 615/1161] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 19:04:39 2022] POST /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 12 19:04:40.045923 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:40.046443 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:40.052833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:40.053286 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:40.054050 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:40.054487 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:40.135418 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'services' on Instance uuid 68e48c87-f65d-46c5-8bb8-629de6e212c8 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:04:40.343271 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1562360f-43e5-4fd7-bef1-61d759c58f6d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments/7375d100-7cf5-4edc-9fea-4b5a48466c5b" status: 202 len: 0 microversion: 2.1 time: 0.301007 Jul 12 19:04:40.344242 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 547/1162] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 19:04:40 2022] DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments/7375d100-7cf5-4edc-9fea-4b5a48466c5b => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:04:40.353765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:40.354688 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:40.362151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:40.362626 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:40.363570 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:40.363998 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:40.395715 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1f0ecb97-a5fe-43a9-bde6-a62dbfc1bbab tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045960 Jul 12 19:04:40.396531 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 616/1163] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:04:40 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:41.407860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:41.409249 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:41.415749 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.416445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.417400 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.417836 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.449544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3a3b2d7b-0220-487f-9a98-02666af09366 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Jul 12 19:04:41.450328 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 548/1164] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:04:41 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:41.581682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:41.581682 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:41.583546 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-0ada06d6-2e87-46b8-820c-f8d583535afd req-8436c28f-0a1a-4f82-a3f0-cbdea71ef0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "269b4dad-a4bb-42b2-a2db-d769ac237200", "tag": "80d57f5e-8737-4f65-8d46-d300fa8ecda2"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:41.584282 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.584833 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.585703 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.586328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.592146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-0ada06d6-2e87-46b8-820c-f8d583535afd req-8436c28f-0a1a-4f82-a3f0-cbdea71ef0f0 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.592595 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-0ada06d6-2e87-46b8-820c-f8d583535afd req-8436c28f-0a1a-4f82-a3f0-cbdea71ef0f0 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.604446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-0ada06d6-2e87-46b8-820c-f8d583535afd req-8436c28f-0a1a-4f82-a3f0-cbdea71ef0f0 service nova] Creating event network-changed:80d57f5e-8737-4f65-8d46-d300fa8ecda2 for instance 269b4dad-a4bb-42b2-a2db-d769ac237200 on hv-cinder-83538 Jul 12 19:04:41.609177 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-0ada06d6-2e87-46b8-820c-f8d583535afd req-8436c28f-0a1a-4f82-a3f0-cbdea71ef0f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032379 Jul 12 19:04:41.609792 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 549/1165] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:41.616248 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:04:41.923227 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-4a2e8841-ae40-4011-94f3-6ac016b29fb3 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "DELETE /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 204 len: 0 microversion: 2.1 time: 0.349259 Jul 12 19:04:41.925621 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 617/1166] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:04:41 2022] DELETE /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:04:41.930949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:41.931775 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:41.938156 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.938608 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:41.939399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:41.940007 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.118833 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:42.126819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-aef7f5eb-b5b0-4fe7-a319-f63d701e4e66 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1579 microversion: 2.1 time: 0.200336 Jul 12 19:04:42.127743 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 550/1167] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:41 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1579 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:04:42.461789 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:42.463147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:42.470150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.470985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.472297 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.472742 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.507444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f759c0c5-1706-4c28-9901-728f640653c9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049974 Jul 12 19:04:42.512791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 618/1168] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:04:42 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 12 19:04:42.569059 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:42.574111 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:42.576320 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.576778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.577589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.578035 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.604755 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Going to try to terminate instance {{(pid=124970) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:04:42.736930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:42.954324 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f79cd1e1-5c3c-4323-8988-fe46f128dafd tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 204 len: 0 microversion: 2.1 time: 0.389486 Jul 12 19:04:42.954924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 551/1169] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:04:42 2022] DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:04:42.964271 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:42.964808 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:42.971180 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.971653 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:42.972673 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:42.973106 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:43.145729 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:43.146438 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:43.153061 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:43.153512 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:43.154315 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:43.154753 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:43.186393 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:43.193195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-f786824e-03ef-4bdc-a3ef-a860271fa170 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1683 microversion: 2.1 time: 0.232858 Jul 12 19:04:43.193816 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 619/1170] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:42 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1683 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:43.326254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:43.334072 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1784b4a3-0fa9-470d-8c4f-68556daf0938 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1460 microversion: 2.1 time: 0.193240 Jul 12 19:04:43.334639 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 552/1171] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:43 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1460 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:04:43.451436 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-e76b778f-573b-4e43-9ac1-00f7e5982938 req-43e86cc4-b797-45e2-9ef8-c39622980d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "269b4dad-a4bb-42b2-a2db-d769ac237200", "name": "network-vif-deleted", "tag": "80d57f5e-8737-4f65-8d46-d300fa8ecda2"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:43.459647 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-e76b778f-573b-4e43-9ac1-00f7e5982938 req-43e86cc4-b797-45e2-9ef8-c39622980d1d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:43.460091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-e76b778f-573b-4e43-9ac1-00f7e5982938 req-43e86cc4-b797-45e2-9ef8-c39622980d1d service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:43.470749 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-e76b778f-573b-4e43-9ac1-00f7e5982938 req-43e86cc4-b797-45e2-9ef8-c39622980d1d service nova] Creating event network-vif-deleted:80d57f5e-8737-4f65-8d46-d300fa8ecda2 for instance 269b4dad-a4bb-42b2-a2db-d769ac237200 on hv-cinder-83538 Jul 12 19:04:43.475634 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-e76b778f-573b-4e43-9ac1-00f7e5982938 req-43e86cc4-b797-45e2-9ef8-c39622980d1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028008 Jul 12 19:04:43.478523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 620/1172] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:44.211446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:44.217724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:44.218338 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:44.218793 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:44.219593 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:44.220031 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:44.351659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:44.352362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:44.358567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:44.359016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:44.359813 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:44.360787 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:44.365148 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:44.372976 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-2f7382eb-2710-47ae-8c9b-782c96c1e4fe tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1683 microversion: 2.1 time: 0.166461 Jul 12 19:04:44.373544 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 553/1173] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:44 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:44.383105 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:44.425708 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584b15b723a94f8bb380b76a2db97fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f20a43af9cc4c68904ba717560e3789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:44.433516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-616bf4bc-1c53-48a4-b901-c6e42eb98841 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 200 len: 1225 microversion: 2.1 time: 0.087220 Jul 12 19:04:44.434071 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 621/1174] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:44 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:04:45.391804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:45.396511 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:45.399824 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:45.400287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:45.401062 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:45.401522 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:45.452970 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:45.453590 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 269b4dad-a4bb-42b2-a2db-d769ac237200] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:45.462288 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:45.463049 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:45.463849 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:45.464278 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:45.479660 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] HTTP exception thrown: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. Jul 12 19:04:45.480250 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Request method failure captured: Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 HTTP/1.1 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcOzd2wPHK6Nq4QFFBIslLU18ZYkdz8YY_tLPrVyuWcP-ufNFzx05vUOENVikowZKNLWyfPAxa7McntpnstfDPSvH1bj5Yqub7qRL132BMcebFg8gu78HIJ01ZKsuqoS4Cws5BZlJl0xrRv04o2ZkY_RDz3Pv4wKC1vO2m7_TY317kI Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:04:45.481532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f20a43af9cc4c68904ba717560e3789", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 584b15b723a94f8bb380b76a2db97fc8 Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. Jul 12 19:04:45.483333 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '269b4dad-a4bb-42b2-a2db-d769ac237200'} Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:45.484349 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. Jul 12 19:04:45.485927 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:45.487443 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Returning 404 to user: Instance 269b4dad-a4bb-42b2-a2db-d769ac237200 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:45.487928 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-d9bcb1f2-74b9-4400-8652-d5b3f3ff4b8a tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200" status: 404 len: 111 microversion: 2.1 time: 0.040206 Jul 12 19:04:45.489315 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 622/1175] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:45 2022] GET /compute/v2.1/servers/269b4dad-a4bb-42b2-a2db-d769ac237200 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 19:04:45.495428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ea1b17d8-eb34-4b90-8102-801b41127d64 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1615 microversion: 2.1 time: 0.105583 Jul 12 19:04:45.495428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 554/1176] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:45 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:45.663706 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-6b84326d-e6bc-4bc8-be4b-526e00d3803d req-be23a867-2a7a-4df2-a370-683dba6e2542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e48c87-f65d-46c5-8bb8-629de6e212c8", "name": "network-vif-deleted", "tag": "261547b7-6b53-4515-97d0-0c0a4f515365"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:45.683973 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6b84326d-e6bc-4bc8-be4b-526e00d3803d req-be23a867-2a7a-4df2-a370-683dba6e2542 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:45.684468 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-6b84326d-e6bc-4bc8-be4b-526e00d3803d req-be23a867-2a7a-4df2-a370-683dba6e2542 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:45.701655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-6b84326d-e6bc-4bc8-be4b-526e00d3803d req-be23a867-2a7a-4df2-a370-683dba6e2542 service nova] Creating event network-vif-deleted:261547b7-6b53-4515-97d0-0c0a4f515365 for instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 on hv-cinder-83538 Jul 12 19:04:45.710277 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-6b84326d-e6bc-4bc8-be4b-526e00d3803d req-be23a867-2a7a-4df2-a370-683dba6e2542 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050968 Jul 12 19:04:45.711656 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 623/1177] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:46.037830 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:46.038332 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:46.044442 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.044887 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.045652 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.046085 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.059529 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] HTTP exception thrown: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Request method failure captured: Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: DELETE /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 HTTP/1.1 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcOzd2wPHK6Nq4QFFBIslLU18ZYkdz8YY_tLPrVyuWcP-ufNFzx05vUOENVikowZKNLWyfPAxa7McntpnstfDPSvH1bj5Yqub7qRL132BMcebFg8gu78HIJ01ZKsuqoS4Cws5BZlJl0xrRv04o2ZkY_RDz3Pv4wKC1vO2m7_TY317kI Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:04:46.061204 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f20a43af9cc4c68904ba717560e3789", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 584b15b723a94f8bb380b76a2db97fc8 Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.062906 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '4323f482-9ab3-46cb-9047-09028e1c3527'} Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:46.064542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.066217 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.069188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Returning 404 to user: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:46.069188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-35bdf0a2-f140-4ca0-800b-135a065304ed tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 404 len: 111 microversion: 2.1 time: 0.028720 Jul 12 19:04:46.069188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 555/1178] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:04:46 2022] DELETE /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:04:46.072320 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:46.073025 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] [instance: 4323f482-9ab3-46cb-9047-09028e1c3527] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:46.079336 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.102566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.102566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.102566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.102566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] HTTP exception thrown: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.102566 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Request method failure captured: Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 HTTP/1.1 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcOzd2wPHK6Nq4QFFBIslLU18ZYkdz8YY_tLPrVyuWcP-ufNFzx05vUOENVikowZKNLWyfPAxa7McntpnstfDPSvH1bj5Yqub7qRL132BMcebFg8gu78HIJ01ZKsuqoS4Cws5BZlJl0xrRv04o2ZkY_RDz3Pv4wKC1vO2m7_TY317kI Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:04:46.103094 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_0f20a43af9cc4c68904ba717560e3789", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/0f20a43af9cc4c68904ba717560e3789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: 0f20a43af9cc4c68904ba717560e3789 Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-TestVolumeBootPattern-652715060 Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 584b15b723a94f8bb380b76a2db97fc8 Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-TestVolumeBootPattern-652715060-project Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.105371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '4323f482-9ab3-46cb-9047-09028e1c3527'} Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:46.106284 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. Jul 12 19:04:46.108306 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:04:46.109732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Returning 404 to user: Instance 4323f482-9ab3-46cb-9047-09028e1c3527 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:46.109732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ec9a135d-618e-4c22-90e0-b0523d5cf440 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527" status: 404 len: 111 microversion: 2.1 time: 0.029200 Jul 12 19:04:46.109732 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 624/1179] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:46 2022] GET /compute/v2.1/servers/4323f482-9ab3-46cb-9047-09028e1c3527 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:04:46.510533 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:46.511155 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:46.518784 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.519504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.525606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.525606 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.555406 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:46.555939 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:46.556499 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'fault' on Instance uuid 68e48c87-f65d-46c5-8bb8-629de6e212c8 {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:04:46.601146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:46.609186 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bd6f4532-2cbc-4a95-a92d-7a15be76391d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 200 len: 1332 microversion: 2.1 time: 0.102488 Jul 12 19:04:46.609827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 556/1180] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:46 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:47.547639 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-da4a40a8-af1f-4084-bf4d-e80765966f60 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] Calling method '.version_select at 0x7f01784c04c0>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:47.624170 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-da4a40a8-af1f-4084-bf4d-e80765966f60 tempest-TestVolumeBootPattern-652715060 tempest-TestVolumeBootPattern-652715060-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1163641014" status: 202 len: 0 microversion: 2.1 time: 0.080389 Jul 12 19:04:47.624934 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 625/1181] 10.222.0.59 () {58 vars in 1262 bytes} [Tue Jul 12 19:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1163641014 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:04:47.626069 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:47.626684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:47.633829 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:47.634851 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:47.635714 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:47.636146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:47.651146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 HTTP/1.1 Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:04:47.652812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:04:47.654600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '68e48c87-f65d-46c5-8bb8-629de6e212c8'} Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:04:47.657645 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:04:47.659701 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:04:47.661689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:04:47.661689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-cbb731a8-2eb3-425d-8fac-945927d3e0d9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 404 len: 111 microversion: 2.1 time: 0.033349 Jul 12 19:04:47.661689 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 557/1182] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:47 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 19:04:47.669526 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-5fee9e08-5555-4f84-8fba-6b8ea10d3274 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '.version_select at 0x7f0178358430>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:47.721508 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-5fee9e08-5555-4f84-8fba-6b8ea10d3274 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476406576" status: 202 len: 0 microversion: 2.1 time: 0.055842 Jul 12 19:04:47.722203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 626/1183] 10.222.0.59 () {58 vars in 1220 bytes} [Tue Jul 12 19:04:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476406576 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:04:48.473093 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-320c5d39-a28a-4d99-8cc0-9feeb993af97 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: .version_select at 0x7f017840f280>, body: {"keypair": {"name": "tempest-keypair-962627115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs0v7HRdxw7DAkEua92dnBWfIVeKbSuZChJy5y7ngWpyDwjLle3iYsII8tVdc2/d++vLhnOl4RMzFzNIJ7awdFAVgAPXxFCrZ6TZ27+viIgDPHUe9MYH7YBnMJIcRwOIw=="}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:48.486902 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-320c5d39-a28a-4d99-8cc0-9feeb993af97 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:04:48.491347 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.quota [None req-320c5d39-a28a-4d99-8cc0-9feeb993af97 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'key_pairs'} {{(pid=124970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:04:48.601433 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-320c5d39-a28a-4d99-8cc0-9feeb993af97 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132336 Jul 12 19:04:48.602034 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 558/1184] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Jul 12 19:04:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:50.789567 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-12110319", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cae8b0f6-4fda-4639-886a-ca703e1b912a"}], "security_groups": [{"name": "tempest-securitygroup--654313328"}], "key_name": "tempest-keypair-962627115", "user_data": "}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:50.796158 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:50.896958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] validate_networks() for [('cae8b0f6-4fda-4639-886a-ca703e1b912a', None, None, None, None, None)] {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 19:04:51.384537 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 19:04:51.385016 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 19:04:51.385561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 19:04:51.386033 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 19:04:51.386510 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 19:04:51.396532 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:51.397126 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:51.397919 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:51.398369 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:51.417383 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:04:51.421969 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Getting quotas for user 22093c019d224597a3fa8f991e88d5f9 and project d38642ca46564ad794bf60e896e1409d. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:04:51.437301 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 19:04:51.439774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 19:04:51.602895 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-45877cb6-5df2-4e80-ac8a-c1e434ec901c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.817988 Jul 12 19:04:51.603917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 627/1185] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 19:04:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 19:04:51.614698 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-11c11072-0f85-4f48-99da-8158e0f36ff4 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:51.615330 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-11c11072-0f85-4f48-99da-8158e0f36ff4 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:51.617287 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:04:51.687037 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-11c11072-0f85-4f48-99da-8158e0f36ff4 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:51.694783 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-11c11072-0f85-4f48-99da-8158e0f36ff4 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1239 microversion: 2.1 time: 0.084554 Jul 12 19:04:51.695522 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 559/1186] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:51 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:52.712637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:52.713270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:52.720175 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:52.720626 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:52.721607 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:52.722042 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:52.804516 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:52.812020 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-e1c6bb5a-bfe5-4e66-bc54-0648754bf16f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1243 microversion: 2.1 time: 0.103278 Jul 12 19:04:52.812593 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 628/1187] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:52 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1243 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:53.829841 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:53.830519 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:53.839014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:53.839504 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:53.840294 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:53.840737 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:53.981847 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:53.992747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ffa8ff78-4407-4751-83e3-a7c1822ff767 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1299 microversion: 2.1 time: 0.166649 Jul 12 19:04:53.993516 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 560/1188] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:53 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:55.010757 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:55.011406 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:55.018916 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:55.019397 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:55.023854 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:55.026659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:55.306643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:55.317179 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-677b54d2-5b6e-4942-90d8-7e9152a78c32 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.309246 Jul 12 19:04:55.321659 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 629/1189] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:55 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:56.020820 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-06704a71-560c-4604-89da-1ae7f9ebe96a req-1247a738-a628-4afd-96c3-5d84bebb41db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8046ba-a5a4-4611-b940-0652642b77ab", "tag": "3607f235-0c10-49a9-a6bb-2c6221483a6f"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:04:56.030633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-06704a71-560c-4604-89da-1ae7f9ebe96a req-1247a738-a628-4afd-96c3-5d84bebb41db service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:56.031080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-06704a71-560c-4604-89da-1ae7f9ebe96a req-1247a738-a628-4afd-96c3-5d84bebb41db service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:56.048696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-06704a71-560c-4604-89da-1ae7f9ebe96a req-1247a738-a628-4afd-96c3-5d84bebb41db service nova] Creating event network-changed:3607f235-0c10-49a9-a6bb-2c6221483a6f for instance da8046ba-a5a4-4611-b940-0652642b77ab on hv-cinder-83538 Jul 12 19:04:56.056534 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-06704a71-560c-4604-89da-1ae7f9ebe96a req-1247a738-a628-4afd-96c3-5d84bebb41db service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039329 Jul 12 19:04:56.057659 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 561/1190] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:04:56.338411 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:56.339901 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:56.345445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:56.345889 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:56.346642 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:56.347087 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:56.492605 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:56.500273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9fee7b54-e851-4144-8b2a-46c196919ae3 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.165723 Jul 12 19:04:56.508184 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 630/1191] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:56 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:57.518733 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:57.520014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:57.526911 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:57.527391 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:57.528408 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:57.528724 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:57.674805 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:57.683161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-68a3db99-249f-4aba-b366-6a1da6981650 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.169012 Jul 12 19:04:57.683796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 562/1192] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:57 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:58.700741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:58.701366 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:58.708713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:58.709165 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:58.709933 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:58.710371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:58.845363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:04:58.853741 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9821abca-c407-4a0f-b672-1f1662da122b tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.156882 Jul 12 19:04:58.854362 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 631/1193] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:58 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:04:59.870372 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:04:59.870958 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:04:59.877428 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:59.877869 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:04:59.878617 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:04:59.879776 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:00.006267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:05:00.013731 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-35824cd1-fad6-4a1e-ab15-8c8c7188cec1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.147308 Jul 12 19:05:00.014279 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 563/1194] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:04:59 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:05:01.014051 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-075188a2-b0a6-48d6-88e8-258da7a66e1a req-49eef3ac-aa15-4661-a23f-5bb5246edbc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8046ba-a5a4-4611-b940-0652642b77ab", "name": "network-vif-plugged", "status": "completed", "tag": "3607f235-0c10-49a9-a6bb-2c6221483a6f"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:05:01.024092 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-075188a2-b0a6-48d6-88e8-258da7a66e1a req-49eef3ac-aa15-4661-a23f-5bb5246edbc5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:01.024533 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-075188a2-b0a6-48d6-88e8-258da7a66e1a req-49eef3ac-aa15-4661-a23f-5bb5246edbc5 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:01.030527 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:05:01.031765 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:05:01.035886 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-075188a2-b0a6-48d6-88e8-258da7a66e1a req-49eef3ac-aa15-4661-a23f-5bb5246edbc5 service nova] Creating event network-vif-plugged:3607f235-0c10-49a9-a6bb-2c6221483a6f for instance da8046ba-a5a4-4611-b940-0652642b77ab on hv-cinder-83538 Jul 12 19:05:01.038491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:01.038943 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:01.039749 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:01.040206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:01.041405 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-075188a2-b0a6-48d6-88e8-258da7a66e1a req-49eef3ac-aa15-4661-a23f-5bb5246edbc5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Jul 12 19:05:01.042009 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 632/1195] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:05:01.177696 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:05:01.185412 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-28674480-3b59-4334-9bb9-f947147fa5fb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.158860 Jul 12 19:05:01.185993 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 564/1196] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:05:01 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:05:02.203784 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:05:02.204402 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:05:02.206353 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:05:02.207017 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=6 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:05:02.213235 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:02.213676 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:02.214435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:02.214865 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:02.345129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:05:02.352798 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c6b2c62c-5472-41be-b68c-59e55afb23f2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1364 microversion: 2.1 time: 0.153306 Jul 12 19:05:02.353360 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 633/1197] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:05:02 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:05:03.369920 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:05:03.370553 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:05:03.372506 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=6 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:05:03.378013 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:03.381191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:03.381191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:03.381191 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:03.511827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:05:03.519589 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-06e6905a-1fd9-4451-b864-b5d6ea8198ef tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1553 microversion: 2.1 time: 0.153732 Jul 12 19:05:03.520146 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 565/1198] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:05:03 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:05:03.542035 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:05:03.542592 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:05:03.548999 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:03.549444 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:03.550204 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:03.550655 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:03.627059 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-b2ba87ef-9107-40a5-a767-1b2070352bb9 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089730 Jul 12 19:05:03.627697 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 634/1199] 10.222.0.59 () {58 vars in 1274 bytes} [Tue Jul 12 19:05:03 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:05:04.843796 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-348cc25e-a2eb-4730-9839-5c43a8de44f7 req-34152e6b-f7ae-4b04-a805-678a048d4253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8046ba-a5a4-4611-b940-0652642b77ab", "tag": "3607f235-0c10-49a9-a6bb-2c6221483a6f"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:05:04.853704 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-348cc25e-a2eb-4730-9839-5c43a8de44f7 req-34152e6b-f7ae-4b04-a805-678a048d4253 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:05:04.854147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-348cc25e-a2eb-4730-9839-5c43a8de44f7 req-34152e6b-f7ae-4b04-a805-678a048d4253 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:05:04.864998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-348cc25e-a2eb-4730-9839-5c43a8de44f7 req-34152e6b-f7ae-4b04-a805-678a048d4253 service nova] Creating event network-changed:3607f235-0c10-49a9-a6bb-2c6221483a6f for instance da8046ba-a5a4-4611-b940-0652642b77ab on hv-cinder-83538 Jul 12 19:05:04.870188 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-348cc25e-a2eb-4730-9839-5c43a8de44f7 req-34152e6b-f7ae-4b04-a805-678a048d4253 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030010 Jul 12 19:05:04.870791 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 566/1200] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:06:09.238744 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:06:09.239528 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=46 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:06:09.243713 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:09.244208 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:09.250488 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:09.252151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:09.252151 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:09.252435 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:09.278990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-39747dcc-1d97-450d-9899-00e5a8d8b042 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.042695 Jul 12 19:06:09.279691 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 635/1201] 10.222.0.59 () {58 vars in 1247 bytes} [Tue Jul 12 19:06:09 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:06:11.842901 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=17 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:06:11.843930 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=64 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:06:11.848712 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c932125-208c-409f-8c20-5752e057f50f"}} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:06:11.851787 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:11.855904 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:11.859087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:11.859087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:11.859087 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:12.589934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-7011f621-982f-4f74-a1ad-784a1122f0d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "POST /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749116 Jul 12 19:06:12.590551 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 567/1202] 10.222.0.59 () {60 vars in 1322 bytes} [Tue Jul 12 19:06:11 2022] POST /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 19:06:20.167197 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:20.167733 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:20.174679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:20.175195 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:20.175942 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:20.176371 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:20.258548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.objects.instance [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'services' on Instance uuid da8046ba-a5a4-4611-b940-0652642b77ab {{(pid=124971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:06:20.414441 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-c3b2f9dc-3895-4565-8793-100b52348939 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments/5c932125-208c-409f-8c20-5752e057f50f" status: 202 len: 0 microversion: 2.1 time: 0.251590 Jul 12 19:06:20.415075 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 636/1203] 10.222.0.59 () {58 vars in 1415 bytes} [Tue Jul 12 19:06:20 2022] DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments/5c932125-208c-409f-8c20-5752e057f50f => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:06:20.424907 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:20.425972 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:20.432002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:20.432446 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:20.437797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:20.437797 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:20.467502 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-9bc9f71c-9974-46b4-bcd1-6ec6fcd2b6eb tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047412 Jul 12 19:06:20.468075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 568/1204] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:06:20 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:06:21.481211 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:21.482225 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:21.488709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:21.489154 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:21.489917 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:21.490347 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:21.520415 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9a73fae7-d8a5-4db6-acae-30fe14fd94e2 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Jul 12 19:06:21.520909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 637/1205] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:06:21 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:06:22.532711 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:22.533550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:22.540119 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.540566 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:22.541329 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.541758 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:22.570254 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-bdda0aa5-b433-4c63-b8c4-5e9dee3d2432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042314 Jul 12 19:06:22.570801 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 569/1206] 10.222.0.59 () {58 vars in 1301 bytes} [Tue Jul 12 19:06:22 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 12 19:06:22.626637 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:22.627147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:22.633445 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.633880 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:22.634630 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.635054 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:22.660038 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:06:22.957325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ba9ef1e4-fd26-42fa-b18e-e0b9c9fa37d1 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 204 len: 0 microversion: 2.1 time: 0.334434 Jul 12 19:06:22.957913 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 638/1207] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:06:22 2022] DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:06:22.966134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:22.968924 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:22.973635 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.974080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:22.974837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:22.975267 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:23.105187 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:06:23.111734 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-de509b09-e4a7-45e0-ba58-b87fc3e2ed3a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1678 microversion: 2.1 time: 0.149468 Jul 12 19:06:23.112285 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 570/1208] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:22 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:06:24.130643 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:24.131373 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:24.137800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:24.138246 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:24.139002 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:24.139469 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:24.273525 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:06:24.281719 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9ac4d400-95dc-4e1a-9a72-da21b7955c4d tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1678 microversion: 2.1 time: 0.156440 Jul 12 19:06:24.282309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 639/1209] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:24 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:06:25.300763 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:25.301774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:25.310014 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:25.310600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:25.312413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:25.312995 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:25.472453 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:06:25.480029 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ac7edefe-a619-4c22-a1cd-86215e0ae34a tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1678 microversion: 2.1 time: 0.184688 Jul 12 19:06:25.480603 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 571/1210] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:25 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 12 19:06:26.085977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-d5db161b-caf3-44c0-a6e4-80b98bcf6241 req-b6497ffc-d8de-4a9c-acfc-88d1a31ff240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8046ba-a5a4-4611-b940-0652642b77ab", "name": "network-vif-deleted", "tag": "3607f235-0c10-49a9-a6bb-2c6221483a6f"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:06:26.096091 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-d5db161b-caf3-44c0-a6e4-80b98bcf6241 req-b6497ffc-d8de-4a9c-acfc-88d1a31ff240 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:26.097722 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-d5db161b-caf3-44c0-a6e4-80b98bcf6241 req-b6497ffc-d8de-4a9c-acfc-88d1a31ff240 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:26.107600 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-d5db161b-caf3-44c0-a6e4-80b98bcf6241 req-b6497ffc-d8de-4a9c-acfc-88d1a31ff240 service nova] Creating event network-vif-deleted:3607f235-0c10-49a9-a6bb-2c6221483a6f for instance da8046ba-a5a4-4611-b940-0652642b77ab on hv-cinder-83538 Jul 12 19:06:26.113216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-d5db161b-caf3-44c0-a6e4-80b98bcf6241 req-b6497ffc-d8de-4a9c-acfc-88d1a31ff240 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.344016 Jul 12 19:06:26.113800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 640/1211] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:06:26.497346 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:26.498201 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:26.505002 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:26.505561 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:26.506357 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:26.506816 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:26.542359 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:26.542813 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:26.543274 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.objects.instance [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lazy-loading 'fault' on Instance uuid da8046ba-a5a4-4611-b940-0652642b77ab {{(pid=124970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 12 19:06:26.587507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22093c019d224597a3fa8f991e88d5f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd38642ca46564ad794bf60e896e1409d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:06:26.595655 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-a813d566-4074-416c-99d8-b2cf0d3bf547 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 200 len: 1329 microversion: 2.1 time: 0.102169 Jul 12 19:06:26.596237 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 572/1212] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:26 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:06:27.614293 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:27.615131 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:27.621363 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:27.621804 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:27.622549 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:27.622975 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:27.636412 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab HTTP/1.1 Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:06:27.638159 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:27.646005 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'da8046ba-a5a4-4611-b940-0652642b77ab'} Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:27.646925 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:27.648617 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:27.650171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:27.650171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-9d95101b-c241-418a-b10a-05390d890716 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 404 len: 111 microversion: 2.1 time: 0.030087 Jul 12 19:06:27.650171 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 641/1213] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:27 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:27.650451 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-10f23d26-0b6f-44c9-9b20-f46794fc3585 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '.version_select at 0x7f017821c9d0>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:27.719855 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-10f23d26-0b6f-44c9-9b20-f46794fc3585 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962627115" status: 202 len: 0 microversion: 2.1 time: 0.073540 Jul 12 19:06:27.720466 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 573/1214] 10.222.0.59 () {58 vars in 1217 bytes} [Tue Jul 12 19:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962627115 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 12 19:06:29.668603 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:29.669108 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:29.676203 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:29.676650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:29.677404 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:29.677843 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:29.691872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab HTTP/1.1 Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:06:29.697174 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.698893 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': 'da8046ba-a5a4-4611-b940-0652642b77ab'} Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:29.699918 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.701523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.703800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:29.703800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-2bff346c-aff8-4df8-84c5-f3a0ed52eb4c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 404 len: 111 microversion: 2.1 time: 0.030031 Jul 12 19:06:29.703800 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 642/1215] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:06:29 2022] DELETE /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:29.704670 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:29.705278 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: da8046ba-a5a4-4611-b940-0652642b77ab] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:29.711835 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:29.712280 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:29.713030 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:29.713463 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:29.726484 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab HTTP/1.1 Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:06:29.728206 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.729961 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': 'da8046ba-a5a4-4611-b940-0652642b77ab'} Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:29.731096 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. Jul 12 19:06:29.732926 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:29.735210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance da8046ba-a5a4-4611-b940-0652642b77ab could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:29.735210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-df541da1-46bd-45e2-b9b5-0331848dbd75 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab" status: 404 len: 111 microversion: 2.1 time: 0.029509 Jul 12 19:06:29.735210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 574/1216] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:29 2022] GET /compute/v2.1/servers/da8046ba-a5a4-4611-b940-0652642b77ab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 19:06:31.016650 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:31.017145 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:31.023693 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.024137 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.024890 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.025325 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.038387 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 HTTP/1.1 Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:06:31.040027 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.041765 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '68e48c87-f65d-46c5-8bb8-629de6e212c8'} Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:31.042704 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.044077 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.045990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:31.045990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-bba79ffa-7df3-49a7-8c8b-f6b035ac3432 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 404 len: 111 microversion: 2.1 time: 0.029506 Jul 12 19:06:31.045990 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 643/1217] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:06:31 2022] DELETE /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:31.049993 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:31.050612 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 68e48c87-f65d-46c5-8bb8-629de6e212c8] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:31.056774 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.057226 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.057986 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.058423 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.072004 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 HTTP/1.1 Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:06:31.073515 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.075258 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '68e48c87-f65d-46c5-8bb8-629de6e212c8'} Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:31.076221 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. Jul 12 19:06:31.078413 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.080021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 68e48c87-f65d-46c5-8bb8-629de6e212c8 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:31.080021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-e248053e-870a-464e-8abf-b4ed7a16748c tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8" status: 404 len: 111 microversion: 2.1 time: 0.028977 Jul 12 19:06:31.080021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 575/1218] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:31 2022] GET /compute/v2.1/servers/68e48c87-f65d-46c5-8bb8-629de6e212c8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:31.084186 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:31.084681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:31.090622 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.091066 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.091847 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.092289 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.107244 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 HTTP/1.1 Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:06:31.108783 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.113696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '7693fc25-26b5-4079-8624-85c79bf6ee39'} Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:31.114683 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.116359 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.117992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:31.117992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-cb73e3e6-c9f6-4d1b-8b75-2e05851b682f tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 404 len: 111 microversion: 2.1 time: 0.029771 Jul 12 19:06:31.117992 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 644/1219] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:06:31 2022] DELETE /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 12 19:06:31.118390 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:31.118997 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 7693fc25-26b5-4079-8624-85c79bf6ee39] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:31.125693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.126134 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.126921 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:31.127388 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:31.140759 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 HTTP/1.1 Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:06:31.142264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.143996 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '7693fc25-26b5-4079-8624-85c79bf6ee39'} Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:31.145015 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. Jul 12 19:06:31.146646 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:31.148137 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 7693fc25-26b5-4079-8624-85c79bf6ee39 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:31.148137 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-f53409b8-a0da-4ae8-b286-13d81be519c6 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39" status: 404 len: 111 microversion: 2.1 time: 0.029147 Jul 12 19:06:31.148137 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 576/1220] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:31 2022] GET /compute/v2.1/servers/7693fc25-26b5-4079-8624-85c79bf6ee39 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:32.416067 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:32.426337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:32.426337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:32.426337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:32.426337 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:32.426791 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:32.438738 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.wsgi [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: request: DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 HTTP/1.1 Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept: application/json Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Accept-Encoding: identity Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Connection: close Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Length: 0 Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Content-Type: application/json Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Host: 10.222.0.59 Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Openstack-System-Scope: None Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Id: None Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Domain-Name: None Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Identity-Status: Confirmed Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Is-Admin-Project: True Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Id: default Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Domain-Name: Default Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Role: reader,member Jul 12 19:06:32.440425 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Roles: reader,member Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Id: default Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Domain-Name: Default Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: method: > Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: exception: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.442113 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: action_args: {'id': '9c043ae0-a1b7-4574-a5c2-9525063c3229'} Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:32.443079 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.444681 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.446554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. {{(pid=124971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:32.446554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-7f5fc7f5-bbed-4254-b826-315111629288 tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 404 len: 111 microversion: 2.1 time: 0.029705 Jul 12 19:06:32.446554 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 645/1221] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:06:32 2022] DELETE /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:32.450299 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:06:32.450912 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] [instance: 9c043ae0-a1b7-4574-a5c2-9525063c3229] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:06:32.457864 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:32.458367 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:32.459128 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:06:32.459591 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:06:32.473537 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] HTTP exception thrown: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Request method failure captured: Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 HTTP/1.1 Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcRYNmgEnPvkOm8ArCbO43hUZrK9EskrZpr4qlKaz5ill1FaF330Kvm3a7xW1ydiuzXDVReM10kjeA55esQlcQwkXwkkc74BQbjobiGYrLUgg83h7zZbXDP2KP5c8vGjTGPURg7m8gFNzoWxinHO9vAoPqAluTROsvQIUksWM3scdUc Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:06:32.475075 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d38642ca46564ad794bf60e896e1409d", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d38642ca46564ad794bf60e896e1409d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: d38642ca46564ad794bf60e896e1409d Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1252343983 Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 22093c019d224597a3fa8f991e88d5f9 Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-AttachVolumeNegativeTest-1252343983-project Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.476827 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '9c043ae0-a1b7-4574-a5c2-9525063c3229'} Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:06:32.477740 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. Jul 12 19:06:32.479325 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:06:32.480747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] Returning 404 to user: Instance 9c043ae0-a1b7-4574-a5c2-9525063c3229 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:06:32.480747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c3ea0b03-2ade-429b-8a45-e158266768cc tempest-AttachVolumeNegativeTest-1252343983 tempest-AttachVolumeNegativeTest-1252343983-project] 10.222.0.59 "GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229" status: 404 len: 111 microversion: 2.1 time: 0.030026 Jul 12 19:06:32.480747 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 577/1222] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:06:32 2022] GET /compute/v2.1/servers/9c043ae0-a1b7-4574-a5c2-9525063c3229 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:06:55.557168 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:06:55.557790 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:06:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:07:44.290214 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:44.291006 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:44.294790 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2021986453", "imageRef": "6794cbc9-2aa4-4c88-9859-2d29e55e39c7", "flavorRef": "452"}} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:07:44.345368 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.network.neutron [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] validate_networks() for None {{(pid=124971) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 12 19:07:44.618231 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Flavor limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 12 19:07:44.618672 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Image limits 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 12 19:07:44.619129 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Flavor pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 12 19:07:44.619558 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Image pref 0:0:0 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 12 19:07:44.619963 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.virt.hardware [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 12 19:07:44.628774 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:44.629176 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:44.629958 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:44.630385 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:44.647096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Getting quotas for project be093600e143481e8f79a095f1c664c4. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 12 19:07:44.650982 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.quota [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Getting quotas for user 0fcf32c4d9aa45db80c5c2400aa1f59a and project be093600e143481e8f79a095f1c664c4. Resources: {'ram', 'instances', 'cores'} {{(pid=124971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 12 19:07:44.662460 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Going to run 1 instances... {{(pid=124971) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 12 19:07:44.664695 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6794cbc9-2aa4-4c88-9859-2d29e55e39c7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 12 19:07:44.752599 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-fdcd7fbb-2014-42ee-b871-3c324f0e8839 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464030 Jul 12 19:07:44.753294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 646/1223] 10.222.0.59 () {60 vars in 1146 bytes} [Tue Jul 12 19:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 12 19:07:44.761385 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:44.762316 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:44.766550 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-fc5d75a7-b5bb-4e5c-91bb-3a2491604976 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:44.767159 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-fc5d75a7-b5bb-4e5c-91bb-3a2491604976 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:44.821147 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-fc5d75a7-b5bb-4e5c-91bb-3a2491604976 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:44.828611 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-fc5d75a7-b5bb-4e5c-91bb-3a2491604976 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1215 microversion: 2.1 time: 0.069120 Jul 12 19:07:44.829179 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 578/1224] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:44 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:45.846548 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-713de904-557c-4518-b5c6-8cb70fa27af6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:45.847267 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-713de904-557c-4518-b5c6-8cb70fa27af6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:45.898125 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-713de904-557c-4518-b5c6-8cb70fa27af6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:45.905294 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-713de904-557c-4518-b5c6-8cb70fa27af6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1215 microversion: 2.1 time: 0.063247 Jul 12 19:07:45.905844 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 647/1225] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:45 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:46.921641 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-3f02c6b1-bfa3-43da-a9aa-830a445cb658 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:46.922239 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-3f02c6b1-bfa3-43da-a9aa-830a445cb658 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:46.977598 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-3f02c6b1-bfa3-43da-a9aa-830a445cb658 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:46.984478 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-3f02c6b1-bfa3-43da-a9aa-830a445cb658 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1215 microversion: 2.1 time: 0.066533 Jul 12 19:07:46.985053 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 579/1226] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:46 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:48.001309 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-1282b327-faaa-443f-994f-492b10bffe50 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:48.001922 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-1282b327-faaa-443f-994f-492b10bffe50 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:48.055679 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-1282b327-faaa-443f-994f-492b10bffe50 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:48.062216 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-1282b327-faaa-443f-994f-492b10bffe50 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1215 microversion: 2.1 time: 0.064836 Jul 12 19:07:48.063096 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 648/1227] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:47 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:49.079662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:49.080205 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:49.087592 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:49.088051 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:49.088819 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:49.089264 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:49.147989 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:49.155256 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8c72acec-f22d-4efa-be05-ba3a77f47ae1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1219 microversion: 2.1 time: 0.080009 Jul 12 19:07:49.155850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 580/1228] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:49 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:50.172886 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:50.173492 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:50.181470 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:50.181921 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:50.182696 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:50.183109 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:50.242514 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:50.249977 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-49741038-1fb1-45d1-be46-329d19074190 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1211 microversion: 2.1 time: 0.081012 Jul 12 19:07:50.250536 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 649/1229] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:50 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:51.268210 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:51.268812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:51.276404 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:51.278399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:51.278399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:51.278399 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:51.561450 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:51.569302 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-1c8be18d-6454-4989-a9ff-ec78845779e2 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1273 microversion: 2.1 time: 0.305394 Jul 12 19:07:51.571144 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 581/1230] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:51 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1273 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:52.587125 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:52.588558 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:52.598346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:52.598346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:52.598346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:52.598346 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:52.790461 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:52.808189 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-106a1344-18ae-4296-b458-bec793878fd8 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.225060 Jul 12 19:07:52.808945 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 650/1231] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:52 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:52.961567 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-208a780c-ae2f-4fe0-8254-61ceffa44618 req-88d8ef38-0174-4c52-bddc-4c29283dc735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a5170a-bcad-499a-8808-bfb7cac99f66", "tag": "43863303-d7b2-4a2c-8421-56730259758b"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:07:52.975445 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-208a780c-ae2f-4fe0-8254-61ceffa44618 req-88d8ef38-0174-4c52-bddc-4c29283dc735 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:52.976023 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-208a780c-ae2f-4fe0-8254-61ceffa44618 req-88d8ef38-0174-4c52-bddc-4c29283dc735 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:52.989850 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-208a780c-ae2f-4fe0-8254-61ceffa44618 req-88d8ef38-0174-4c52-bddc-4c29283dc735 service nova] Creating event network-changed:43863303-d7b2-4a2c-8421-56730259758b for instance 97a5170a-bcad-499a-8808-bfb7cac99f66 on hv-cinder-83538 Jul 12 19:07:52.995021 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-208a780c-ae2f-4fe0-8254-61ceffa44618 req-88d8ef38-0174-4c52-bddc-4c29283dc735 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039139 Jul 12 19:07:52.995845 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 582/1232] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:07:53.824439 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:53.825072 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:53.831734 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:53.832760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:53.833657 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:53.834090 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:53.964117 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:53.971465 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-dac087ad-6220-4aab-adab-bf7648eda282 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.150887 Jul 12 19:07:53.972030 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 651/1233] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:53 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:54.989919 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:54.990542 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:54.996722 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:54.997170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:54.997940 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:54.998376 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:55.127721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:55.135684 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-b25ced1b-9408-4b2c-ba08-a15162efa760 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.150522 Jul 12 19:07:55.136251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 583/1234] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:54 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:56.152523 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:56.153055 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:56.154899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=2 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:56.161147 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:56.161799 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:56.180328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:56.180328 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:56.294254 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:56.301615 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-0a03e628-7a7d-4a3f-9fd9-1d7e8efeed01 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.153003 Jul 12 19:07:56.302188 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 652/1235] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:56 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:57.319862 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:57.320475 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:57.322860 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG dbcounter [-] [124970] Writing DB stats nova_cell0:SELECT=4 {{(pid=124970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:57.327721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:57.328171 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:57.328987 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:57.329430 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:57.455600 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:57.464089 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-79b228e5-0a4e-4740-994c-feb4824940a9 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.148721 Jul 12 19:07:57.464668 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 584/1236] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:57 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:57.887797 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [req-621bccc5-09e3-415d-99c5-d56c13716816 req-fe825d75-910b-4b35-92ee-9e1e13e34c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a5170a-bcad-499a-8808-bfb7cac99f66", "name": "network-vif-plugged", "status": "completed", "tag": "43863303-d7b2-4a2c-8421-56730259758b"}]} {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:07:57.896376 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-621bccc5-09e3-415d-99c5-d56c13716816 req-fe825d75-910b-4b35-92ee-9e1e13e34c73 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:57.907001 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [req-621bccc5-09e3-415d-99c5-d56c13716816 req-fe825d75-910b-4b35-92ee-9e1e13e34c73 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:57.909093 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.compute.server_external_events [req-621bccc5-09e3-415d-99c5-d56c13716816 req-fe825d75-910b-4b35-92ee-9e1e13e34c73 service nova] Creating event network-vif-plugged:43863303-d7b2-4a2c-8421-56730259758b for instance 97a5170a-bcad-499a-8808-bfb7cac99f66 on hv-cinder-83538 Jul 12 19:07:57.914283 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [req-621bccc5-09e3-415d-99c5-d56c13716816 req-fe825d75-910b-4b35-92ee-9e1e13e34c73 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092495 Jul 12 19:07:57.914849 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 653/1237] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 12 19:07:58.481288 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:58.481909 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:58.488867 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:58.489317 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:58.490080 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:58.490517 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:58.618431 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:58.625934 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-8c028eca-9907-4c37-bb13-d3c785cbfd74 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.148502 Jul 12 19:07:58.626491 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 585/1238] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:58 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:07:59.642484 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG dbcounter [-] [124971] Writing DB stats nova_cell0:SELECT=10 {{(pid=124971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 19:07:59.647838 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:07:59.648545 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:07:59.654602 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:59.655052 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:59.660546 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:07:59.660546 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:07:59.834877 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:07:59.842379 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-021d270c-1255-4f3c-b2e1-471363d7e5da tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1315 microversion: 2.1 time: 0.200811 Jul 12 19:07:59.842949 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 654/1239] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:07:59 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:08:00.858881 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:00.859519 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:00.865946 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:00.866420 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:00.867180 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:00.867647 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:00.998789 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:08:01.006706 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-c51b724a-23ed-40fe-ac50-4f01d0ab906c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1465 microversion: 2.1 time: 0.151701 Jul 12 19:08:01.007381 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 586/1240] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:08:00 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:08:01.045433 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:01.045909 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:01.052442 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:01.052879 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:01.053626 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:01.054063 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:01.078760 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Going to try to terminate instance {{(pid=124971) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 12 19:08:01.385045 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-8aa01c53-92f6-4305-9517-169bd1f5c6d6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "DELETE /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 204 len: 0 microversion: 2.1 time: 0.342712 Jul 12 19:08:01.385561 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 655/1241] 10.222.0.59 () {58 vars in 1238 bytes} [Tue Jul 12 19:08:01 2022] DELETE /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 12 19:08:01.393863 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:01.395251 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:01.401361 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:01.401804 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:01.402560 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:01.402992 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:01.528778 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.policy [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124970) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:08:01.536777 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-44725420-0765-4044-bd97-0e60d6914838 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1471 microversion: 2.1 time: 0.147023 Jul 12 19:08:01.537340 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 587/1242] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:08:01 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1471 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:08:01.698633 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:08:01.698837 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:08:01.833313 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:08:01.833534 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:08:02.555150 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:02.555872 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:02.562506 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:02.562985 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:02.563812 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:02.564273 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:02.697039 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:08:02.704667 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-ef08230c-2f82-4602-b117-6cf7facee39c tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1471 microversion: 2.1 time: 0.154373 Jul 12 19:08:02.711040 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 656/1243] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:08:02 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:08:03.510998 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [req-c30f97c7-4055-4b89-a99b-618646ea8851 req-ac7912ca-966a-4859-bc07-736ea2461003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a5170a-bcad-499a-8808-bfb7cac99f66", "name": "network-vif-deleted", "tag": "43863303-d7b2-4a2c-8421-56730259758b"}]} {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 12 19:08:03.520662 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c30f97c7-4055-4b89-a99b-618646ea8851 req-ac7912ca-966a-4859-bc07-736ea2461003 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:03.520856 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [req-c30f97c7-4055-4b89-a99b-618646ea8851 req-ac7912ca-966a-4859-bc07-736ea2461003 service nova] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:03.532693 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.compute.server_external_events [req-c30f97c7-4055-4b89-a99b-618646ea8851 req-ac7912ca-966a-4859-bc07-736ea2461003 service nova] Creating event network-vif-deleted:43863303-d7b2-4a2c-8421-56730259758b for instance 97a5170a-bcad-499a-8808-bfb7cac99f66 on hv-cinder-83538 Jul 12 19:08:03.537949 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [req-c30f97c7-4055-4b89-a99b-618646ea8851 req-ac7912ca-966a-4859-bc07-736ea2461003 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030932 Jul 12 19:08:03.538721 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 588/1244] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Jul 12 19:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 12 19:08:03.722070 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.api.openstack.wsgi [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:03.722899 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.compute.api [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124971) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:03.730206 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:03.735569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:03.735569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:03.735569 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG oslo_concurrency.lockutils [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:03.801651 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: DEBUG nova.policy [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcf32c4d9aa45db80c5c2400aa1f59a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be093600e143481e8f79a095f1c664c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124971) authorize /opt/stack/nova/nova/policy.py:199}} Jul 12 19:08:03.809701 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO nova.api.openstack.requestlog [None req-026fbf69-3ac2-4489-8928-9dbe8278dcf6 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 200 len: 1300 microversion: 2.1 time: 0.091567 Jul 12 19:08:03.810270 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: [pid: 124971|app: 0|req: 657/1245] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:08:03 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 12 19:08:04.829400 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Calling method '>' {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 12 19:08:04.830129 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.compute.api [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] [instance: 97a5170a-bcad-499a-8808-bfb7cac99f66] Fetching instance by UUID {{(pid=124970) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 12 19:08:04.836522 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:04.836968 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:04.837728 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 12 19:08:04.838161 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG oslo_concurrency.lockutils [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Lock "35fbcab1-4fbf-4d9a-acd5-685fb6ee233f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 12 19:08:04.852727 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.wsgi [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] HTTP exception thrown: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Request method failure captured: Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: request: GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 HTTP/1.1 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept: application/json Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Accept-Encoding: identity Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Connection: close Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Length: 0 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Content-Type: application/json Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Host: 10.222.0.59 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Openstack-System-Scope: None Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: User-Agent: python-urllib3/1.26.9 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Auth-Token: gAAAAABizcZ-PcsgT6ydfjNeCLn_Xzj7a81eT8mh_-GGHwp7j5STzmqJ_RdVjqo8929Y0TTIF9esEzY90H65l16TV6T2R1V6NIYm9Y4gXj2nWP5T2D7r5A84qrYXizA4nd2lMU2LKsu1ps8kKr8zCKEmDwjpggt9lrS9eG_FjefYYv7-n8WgNps Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Id: None Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Domain-Name: None Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Identity-Status: Confirmed Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Is-Admin-Project: True Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Id: default Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Domain-Name: Default Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Id: be093600e143481e8f79a095f1c664c4 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Project-Name: tempest-VolumesNegativeTest-1219966876 Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Role: reader,member Jul 12 19:08:04.854373 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Roles: reader,member Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/be093600e143481e8f79a095f1c664c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_be093600e143481e8f79a095f1c664c4", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/be093600e143481e8f79a095f1c664c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/be093600e143481e8f79a095f1c664c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}] Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant: tempest-VolumesNegativeTest-1219966876 Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Id: be093600e143481e8f79a095f1c664c4 Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-Tenant-Name: tempest-VolumesNegativeTest-1219966876 Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User: tempest-VolumesNegativeTest-1219966876-project Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Id: default Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Domain-Name: Default Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Id: 0fcf32c4d9aa45db80c5c2400aa1f59a Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: X-User-Name: tempest-VolumesNegativeTest-1219966876-project Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: method: > Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: exception: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. Jul 12 19:08:04.856038 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: action_args: {'id': '97a5170a-bcad-499a-8808-bfb7cac99f66'} Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: {{(pid=124970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 12 19:08:04.856956 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. Jul 12 19:08:04.858840 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: ERROR nova.api.openstack.wsgi Jul 12 19:08:04.860414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: DEBUG nova.api.openstack.wsgi [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] Returning 404 to user: Instance 97a5170a-bcad-499a-8808-bfb7cac99f66 could not be found. {{(pid=124970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 12 19:08:04.860414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO nova.api.openstack.requestlog [None req-ce69fff8-96bd-42aa-a741-8b8170a6f4c1 tempest-VolumesNegativeTest-1219966876 tempest-VolumesNegativeTest-1219966876-project] 10.222.0.59 "GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66" status: 404 len: 111 microversion: 2.1 time: 0.031136 Jul 12 19:08:04.860414 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: [pid: 124970|app: 0|req: 589/1246] 10.222.0.59 () {58 vars in 1235 bytes} [Tue Jul 12 19:08:04 2022] GET /compute/v2.1/servers/97a5170a-bcad-499a-8808-bfb7cac99f66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 12 19:09:44.998805 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:09:44.999478 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:09:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:10:15.564595 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:10:15.565255 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:10:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:11:21.706170 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:11:21.706812 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:11:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:11:21.842495 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:11:21.843032 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:11:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:13:05.006685 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:13:05.007218 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:13:15.259849 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:13:15.260507 dv-cinder-835384-15-iscsi devstack@n-api.service[124970]: Tue Jul 12 19:13:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:13:35.572709 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:13:35.573335 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:13:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 12 19:13:39.197036 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 12 19:13:39.197606 dv-cinder-835384-15-iscsi devstack@n-api.service[124971]: Tue Jul 12 19:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!